2025-07-09 21:58:15,131 [ 41121 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-07-09 21:58:15,131 [ 41121 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2025-07-09 21:58:15,131 [ 41121 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2025-07-09 21:58:15,131 [ 41121 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_2f7iop --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility test_allow_feature_tier/test.py::test_allow_feature_tier_in_user test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_attach_table_normalizer/test.py::test_attach_substr test_attach_table_normalizer/test.py::test_attach_substr_restart 'test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0]' 'test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576]' test_backup_restore_new/test_cancel_backup.py::test_cancel_backup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup test_backup_restore_on_cluster/test_different_versions.py::test_different_versions test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy]' test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column test_broken_projections/test.py::test_broken_ignored test_broken_projections/test.py::test_broken_ignored_replicated test_broken_projections/test.py::test_broken_on_start test_broken_projections/test.py::test_broken_projections_in_backups_2 test_broken_projections/test.py::test_broken_projections_in_backups_3 test_broken_projections/test.py::test_check_part_thread test_broken_projections/test.py::test_disappeared_projection_on_start test_broken_projections/test.py::test_materialize_broken_projection test_broken_projections/test.py::test_mutation_with_broken_projection test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop test_cluster_discovery/test_password.py::test_connect_with_password test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility test_compression_nested_columns/test.py::test_nested_compression_codec test_concurrent_queries_for_user_restriction/test.py::test_exception_message test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_config_reloader_interval/test.py::test_reload_config test_config_xml_main/test.py::test_xml_main_conf test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 'test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk]' 'test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume]' test_custom_settings/test.py::test_custom_settings test_custom_settings/test.py::test_illformed_setting test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach test_dictionaries_access/test.py::test_create test_dictionaries_access/test.py::test_dictget test_dictionaries_access/test.py::test_drop 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed]' test_dictionaries_redis/test_long.py::test_redis_dict_long 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0]' 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3]' test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster test_disk_access_storage/test.py::test_alter test_disk_access_storage/test.py::test_create test_disk_access_storage/test.py::test_drop test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable test_distributed_config/test.py::test_distibuted_settings test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl test_distributed_ddl_on_cross_replication/test.py::test_atomic_database test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors test_distributed_load_balancing/test.py::test_load_balancing_default test_distributed_load_balancing/test.py::test_load_balancing_first_or_random test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance test_distributed_load_balancing/test.py::test_load_balancing_in_order test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname 'test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority]' 'test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative]' test_distributed_load_balancing/test.py::test_load_balancing_round_robin test_enabling_access_management/test.py::test_enabling_access_management test_encrypted_disk_replication/test.py::test_replication test_encrypted_disk_replication/test.py::test_zero_copy_replication test_endpoint_macro_substitution/test.py::test_select_by_type test_executable_dictionary/test.py::test_executable_implicit_input_argument_python test_executable_dictionary/test.py::test_executable_implicit_input_bash -vvv " altinityinfra/integration-tests-runner:ad96270260ff '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_broken_projections/test.py::test_broken_ignored test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache] test_disk_access_storage/test.py::test_alter test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] test_dictionaries_access/test.py::test_create test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool [gw5] [ 1%] PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings [gw8] [ 2%] PASSED test_dictionaries_access/test.py::test_create test_dictionaries_access/test.py::test_dictget [gw8] [ 3%] PASSED test_dictionaries_access/test.py::test_dictget test_dictionaries_access/test.py::test_drop [gw8] [ 4%] PASSED test_dictionaries_access/test.py::test_drop [gw6] [ 5%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl [gw5] [ 6%] PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility [gw1] [ 7%] PASSED test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors test_distributed_load_balancing/test.py::test_load_balancing_default [gw5] [ 8%] PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility test_allow_feature_tier/test.py::test_allow_feature_tier_in_user [gw4] [ 9%] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] [gw6] [ 10%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] [gw4] [ 11%] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] [gw4] [ 12%] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] [gw9] [ 13%] PASSED test_disk_access_storage/test.py::test_alter test_disk_access_storage/test.py::test_create [gw4] [ 14%] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] [gw6] [ 15%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] [gw4] [ 16%] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] [gw4] [ 17%] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] [gw5] [ 18%] PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_user test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile [gw0] [ 19%] PASSED test_broken_projections/test.py::test_broken_ignored test_broken_projections/test.py::test_broken_ignored_replicated [gw5] [ 20%] PASSED test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile [gw6] [ 21%] PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] test_attach_table_normalizer/test.py::test_attach_substr [gw9] [ 22%] PASSED test_disk_access_storage/test.py::test_create test_disk_access_storage/test.py::test_drop [gw8] [ 23%] PASSED test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl test_distributed_ddl_on_cross_replication/test.py::test_atomic_database [gw3] [ 24%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated [gw7] [ 25%] PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed] [gw0] [ 26%] PASSED test_broken_projections/test.py::test_broken_ignored_replicated test_broken_projections/test.py::test_broken_on_start test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0] [gw8] [ 27%] PASSED test_distributed_ddl_on_cross_replication/test.py::test_atomic_database test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl [gw8] [ 28%] PASSED test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl [gw5] [ 29%] PASSED test_attach_table_normalizer/test.py::test_attach_substr test_attach_table_normalizer/test.py::test_attach_substr_restart test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table [gw5] [ 30%] PASSED test_attach_table_normalizer/test.py::test_attach_substr_restart test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility [gw7] [ 31%] PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat] [gw9] [ 32%] PASSED test_disk_access_storage/test.py::test_drop [gw2] [ 33%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache] test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct] test_backup_restore_new/test_cancel_backup.py::test_cancel_backup [gw0] [ 34%] PASSED test_broken_projections/test.py::test_broken_on_start test_broken_projections/test.py::test_broken_projections_in_backups_2 [gw8] [ 35%] PASSED test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility [gw8] [ 36%] PASSED test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility [gw4] [ 37%] PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path [gw0] [ 38%] PASSED test_broken_projections/test.py::test_broken_projections_in_backups_2 test_broken_projections/test.py::test_broken_projections_in_backups_3 test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary [gw4] [ 39%] PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path [gw0] [ 40%] PASSED test_broken_projections/test.py::test_broken_projections_in_backups_3 test_broken_projections/test.py::test_check_part_thread test_custom_settings/test.py::test_custom_settings [gw8] [ 41%] PASSED test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary [gw0] [ 42%] PASSED test_broken_projections/test.py::test_check_part_thread test_broken_projections/test.py::test_disappeared_projection_on_start [gw8] [ 43%] PASSED test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary [gw2] [ 44%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct] test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed] [gw7] [ 45%] PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat] test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed] test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active [gw8] [ 46%] SKIPPED test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active [gw4] [ 47%] PASSED test_custom_settings/test.py::test_custom_settings test_custom_settings/test.py::test_illformed_setting [gw4] [ 48%] PASSED test_custom_settings/test.py::test_illformed_setting [gw0] [ 49%] PASSED test_broken_projections/test.py::test_disappeared_projection_on_start test_broken_projections/test.py::test_materialize_broken_projection [gw1] [ 50%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_default test_distributed_load_balancing/test.py::test_load_balancing_first_or_random test_backup_restore_on_cluster/test_different_versions.py::test_different_versions test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column [gw0] [ 51%] PASSED test_broken_projections/test.py::test_materialize_broken_projection test_broken_projections/test.py::test_mutation_with_broken_projection [gw2] [ 52%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed] [gw7] [ 53%] PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed] [gw3] [ 54%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas [gw4] [ 55%] FAILED test_backup_restore_on_cluster/test_different_versions.py::test_different_versions [gw0] [ 56%] PASSED test_broken_projections/test.py::test_mutation_with_broken_projection test_encrypted_disk_replication/test.py::test_replication test_compression_nested_columns/test.py::test_nested_compression_codec [gw2] [ 57%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache] test_cluster_discovery/test_password.py::test_connect_with_password [gw4] [ 58%] PASSED test_cluster_discovery/test_password.py::test_connect_with_password [gw0] [ 59%] PASSED test_compression_nested_columns/test.py::test_nested_compression_codec test_concurrent_queries_for_user_restriction/test.py::test_exception_message [gw7] [ 60%] PASSED test_encrypted_disk_replication/test.py::test_replication test_encrypted_disk_replication/test.py::test_zero_copy_replication test_config_xml_main/test.py::test_xml_main_conf [gw7] [ 61%] PASSED test_encrypted_disk_replication/test.py::test_zero_copy_replication [gw4] [ 62%] PASSED test_concurrent_queries_for_user_restriction/test.py::test_exception_message [gw0] [ 63%] PASSED test_config_xml_main/test.py::test_xml_main_conf test_dictionaries_redis/test_long.py::test_redis_dict_long [gw2] [ 64%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache] test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct] test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach [gw9] [ 65%] PASSED test_backup_restore_new/test_cancel_backup.py::test_cancel_backup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup [gw4] [ 66%] PASSED test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load [gw1] [ 67%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_first_or_random test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster [gw7] [ 68%] PASSED test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable [gw9] [ 69%] PASSED test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup test_executable_dictionary/test.py::test_executable_implicit_input_argument_python [gw2] [ 70%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct] test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat] [gw9] [ 71%] PASSED test_executable_dictionary/test.py::test_executable_implicit_input_argument_python test_executable_dictionary/test.py::test_executable_implicit_input_bash [gw9] [ 72%] PASSED test_executable_dictionary/test.py::test_executable_implicit_input_bash [gw3] [ 73%] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool [gw7] [ 74%] PASSED test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable [gw6] [ 75%] PASSED test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0] test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576] [gw4] [ 76%] PASSED test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster [gw3] [ 77%] PASSED test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_endpoint_macro_substitution/test.py::test_select_by_type [gw6] [ 78%] PASSED test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576] [gw0] [ 79%] PASSED test_dictionaries_redis/test_long.py::test_redis_dict_long test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf test_distributed_config/test.py::test_distibuted_settings [gw2] [ 80%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat] test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed] [gw4] [ 81%] PASSED test_endpoint_macro_substitution/test.py::test_select_by_type [gw3] [ 82%] PASSED test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf [gw0] [ 83%] PASSED test_distributed_config/test.py::test_distibuted_settings test_enabling_access_management/test.py::test_enabling_access_management test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk] [gw0] [ 84%] PASSED test_enabling_access_management/test.py::test_enabling_access_management [gw2] [ 85%] PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed] [gw1] [ 86%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance test_distributed_load_balancing/test.py::test_load_balancing_in_order [gw1] [ 87%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_in_order test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname [gw6] [ 88%] FAILED test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk] test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume] [gw1] [ 89%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority] [gw1] [ 90%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority] test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative] [gw1] [ 91%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative] test_distributed_load_balancing/test.py::test_load_balancing_round_robin [gw1] [ 92%] PASSED test_distributed_load_balancing/test.py::test_load_balancing_round_robin [gw6] [ 93%] FAILED test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume] [gw5] [ 94%] ERROR test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible [gw5] [ 95%] ERROR test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_ddl_alter_query/test.py::test_alter [gw5] [ 96%] PASSED test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change [gw5] [ 97%] PASSED test_ddl_alter_query/test.py::test_ddl_queue_hostname_change [gw8] [ 98%] PASSED test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop [gw8] [ 99%] PASSED test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop test_config_reloader_interval/test.py::test_reload_config [gw8] [100%] PASSED test_config_reloader_interval/test.py::test_reload_config ==================================== ERRORS ==================================== _________________ ERROR at setup of test_new_client_compatible _________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def start_cluster(): try: > cluster.start() test_backward_compatibility/test_insert_profile_events.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:27: in inner raise e helpers/retry_decorator.py:20: in inner func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env', '--project-name', 'roottestbackwardcompatibilityinsertprofileevents-gw5', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args: Union[Sequence[str], str], env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ) -> str: if shell: if isinstance(args, str): shell_args = args else: shell_args = next(a for a in args) else: shell_args = " ".join(args) logging.debug("Command:[%s]", shell_args) if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return "" res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout, check=False, ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug("Stdout:%s", outline) for errline in err.splitlines(): logging.debug("Stderr:%s", errline) if res.returncode != 0: logging.debug("Exitcode:%s", res.returncode) if env: logging.debug("Env:%s", env) if not nothrow: > raise Exception( f"Command [{shell_args}] return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: old_node Pulling E upstream_node Pulling E upstream_node Pulled E 8ee087424735 Pulling fs layer E 95fbdc905868 Pulling fs layer E d392064e98fe Pulling fs layer E 14a2db583838 Pulling fs layer E f56c561313a5 Pulling fs layer E 6a9107c62552 Pulling fs layer E 6f2ba4009a06 Pulling fs layer E 8bd1c9b32ce1 Pulling fs layer E 419ba6210003 Pulling fs layer E 14a2db583838 Waiting E f56c561313a5 Waiting E 6a9107c62552 Waiting E 6f2ba4009a06 Waiting E 8bd1c9b32ce1 Waiting E 419ba6210003 Waiting E 8ee087424735 Retrying in 5 seconds E 95fbdc905868 Downloading [> ] 100.7kB/9.576MB E d392064e98fe Downloading [> ] 524.9kB/247.9MB E 95fbdc905868 Verifying Checksum E 95fbdc905868 Download complete E 14a2db583838 Downloading [==================================================>] 92B/92B E 14a2db583838 Verifying Checksum E 14a2db583838 Download complete E f56c561313a5 Downloading [========> ] 3.646kB/22.5kB E f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB E f56c561313a5 Verifying Checksum E f56c561313a5 Download complete E 6a9107c62552 Downloading [> ] 13.78kB/863.5kB E 6a9107c62552 Download complete E 6f2ba4009a06 Downloading [==================================================>] 149B/149B E 6f2ba4009a06 Download complete E 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B E 8bd1c9b32ce1 Verifying Checksum E 8bd1c9b32ce1 Download complete E 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB E 419ba6210003 Verifying Checksum E 419ba6210003 Download complete E d392064e98fe Downloading [=====> ] 29.29MB/247.9MB E d392064e98fe Downloading [============> ] 64.38MB/247.9MB E d392064e98fe Downloading [===================> ] 96.13MB/247.9MB E d392064e98fe Downloading [=========================> ] 126.2MB/247.9MB E d392064e98fe Downloading [===============================> ] 157.4MB/247.9MB E d392064e98fe Downloading [=======================================> ] 194.2MB/247.9MB E d392064e98fe Downloading [=============================================> ] 226.5MB/247.9MB E d392064e98fe Verifying Checksum E d392064e98fe Download complete E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 15 seconds E 8ee087424735 Retrying in 14 seconds E 8ee087424735 Retrying in 13 seconds E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 20 seconds E 8ee087424735 Retrying in 19 seconds E 8ee087424735 Retrying in 18 seconds E 8ee087424735 Retrying in 17 seconds E 8ee087424735 Retrying in 16 seconds E 8ee087424735 Retrying in 15 seconds E 8ee087424735 Retrying in 14 seconds E 8ee087424735 Retrying in 13 seconds E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Pulling fs layer E 95fbdc905868 Pulling fs layer E d392064e98fe Pulling fs layer E 14a2db583838 Pulling fs layer E f56c561313a5 Pulling fs layer E 6a9107c62552 Pulling fs layer E 6f2ba4009a06 Pulling fs layer E 8bd1c9b32ce1 Pulling fs layer E 419ba6210003 Pulling fs layer E f56c561313a5 Download complete E 8ee087424735 Retrying in 13 seconds E 95fbdc905868 Download complete E d392064e98fe Download complete E 14a2db583838 Download complete E 6f2ba4009a06 Download complete E 6a9107c62552 Download complete E 8bd1c9b32ce1 Download complete E 419ba6210003 Download complete E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 19 seconds E 8ee087424735 Retrying in 18 seconds E 8ee087424735 Retrying in 17 seconds E 8ee087424735 Retrying in 16 seconds E 8ee087424735 Retrying in 15 seconds E 8ee087424735 Retrying in 14 seconds E 8ee087424735 Retrying in 13 seconds E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E unexpected EOF helpers/cluster.py:153: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2025-07-09 21:59:20 [ 674 ] INFO : Running tests in /ClickHouse/tests/integration/test_backward_compatibility/test_insert_profile_events.py (cluster.py:2672, start) 2025-07-09 21:59:20 [ 674 ] DEBUG : Cluster start called. is_up=False (cluster.py:2679, start) 2025-07-09 21:59:20 [ 674 ] DEBUG : Docker networks for project roottestbackwardcompatibilityinsertprofileevents-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 21:59:20 [ 674 ] DEBUG : Docker containers for project roottestbackwardcompatibilityinsertprofileevents-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 21:59:20 [ 674 ] DEBUG : Docker volumes for project roottestbackwardcompatibilityinsertprofileevents-gw5 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 21:59:20 [ 674 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-09 21:59:20 [ 674 ] DEBUG : Docker networks for project roottestbackwardcompatibilityinsertprofileevents-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 21:59:20 [ 674 ] DEBUG : Docker containers for project roottestbackwardcompatibilityinsertprofileevents-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 21:59:20 [ 674 ] DEBUG : Docker volumes for project roottestbackwardcompatibilityinsertprofileevents-gw5 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 21:59:20 [ 674 ] DEBUG : Command:[docker container list --all --filter name='^/roottestbackwardcompatibilityinsertprofileevents-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-09 21:59:20 [ 674 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-09 21:59:20 [ 674 ] DEBUG : No running containers for project: roottestbackwardcompatibilityinsertprofileevents-gw5 (cluster.py:874, cleanup) 2025-07-09 21:59:20 [ 674 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-09 21:59:21 [ 674 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-09 21:59:21 [ 674 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-09 21:59:21 [ 674 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 21:59:21 [ 674 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-09 21:59:21 [ 674 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-09 21:59:21 [ 674 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-09 21:59:21 [ 674 ] DEBUG : Stdout:2 (cluster.py:145, run_and_check) 2025-07-09 21:59:21 [ 674 ] DEBUG : Command:[docker volume prune -f] (cluster.py:121, run_and_check) 2025-07-09 21:59:21 [ 674 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 21:59:21 [ 674 ] DEBUG : Volumes pruned: 2 (cluster.py:910, cleanup) 2025-07-09 21:59:21 [ 674 ] DEBUG : Setup directory for instance: upstream_node (cluster.py:2692, start) 2025-07-09 21:59:21 [ 674 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/configs/config.d (cluster.py:4649, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/database (cluster.py:4666, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/logs (cluster.py:4677, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Setup directory for instance: old_node (cluster.py:2692, start) 2025-07-09 21:59:21 [ 674 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/configs/config.d (cluster.py:4649, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/database (cluster.py:4666, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/logs (cluster.py:4677, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-09 21:59:21 [ 674 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env (cluster.py:96, _create_env_file) 2025-07-09 21:59:21 [ 674 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-09 21:59:21 [ 674 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-09 21:59:21 [ 674 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-09 21:59:21 [ 674 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-09 21:59:21 [ 674 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-07-09 21:59:21 [ 674 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: upstream_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: old_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: upstream_node Pulled (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6a9107c62552 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 419ba6210003 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 14a2db583838 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 95fbdc905868 Downloading [> ] 109.3kB/9.576MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [> ] 557.1kB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 95fbdc905868 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 14a2db583838 Downloading [==================================================>] 92B/92B (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 14a2db583838 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [========> ] 3.646kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6a9107c62552 Downloading [> ] 13.78kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=====> ] 29.48MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6a9107c62552 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Downloading [==================================================>] 149B/149B (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 419ba6210003 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [==============> ] 71.7MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [===================> ] 95.52MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=======================> ] 117.7MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [===========================> ] 137.7MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=================================> ] 163.9MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=====================================> ] 188.3MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=============================================> ] 225MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Stderr:unexpected EOF (cluster.py:147, run_and_check) 2025-07-09 22:01:17 [ 674 ] DEBUG : Exitcode:18 (cluster.py:149, run_and_check) 2025-07-09 22:01:17 [ 674 ] INFO : Got exception pulling images: Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: upstream_node Pulling old_node Pulling upstream_node Pulled 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer 6a9107c62552 Waiting 6f2ba4009a06 Waiting 419ba6210003 Waiting 14a2db583838 Waiting f56c561313a5 Waiting 8bd1c9b32ce1 Waiting 8ee087424735 Retrying in 5 seconds 95fbdc905868 Downloading [> ] 109.3kB/9.576MB d392064e98fe Downloading [> ] 557.1kB/247.9MB 95fbdc905868 Verifying Checksum 95fbdc905868 Download complete 14a2db583838 Downloading [==================================================>] 92B/92B 14a2db583838 Verifying Checksum 14a2db583838 Download complete f56c561313a5 Downloading [========> ] 3.646kB/22.5kB f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB f56c561313a5 Verifying Checksum f56c561313a5 Download complete 6a9107c62552 Downloading [> ] 13.78kB/863.5kB d392064e98fe Downloading [=====> ] 29.48MB/247.9MB 6a9107c62552 Verifying Checksum 6a9107c62552 Download complete 6f2ba4009a06 Downloading [==================================================>] 149B/149B 6f2ba4009a06 Verifying Checksum 6f2ba4009a06 Download complete 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B 8bd1c9b32ce1 Verifying Checksum 8bd1c9b32ce1 Download complete 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB 419ba6210003 Verifying Checksum 419ba6210003 Download complete d392064e98fe Downloading [==============> ] 71.7MB/247.9MB d392064e98fe Downloading [===================> ] 95.52MB/247.9MB d392064e98fe Downloading [=======================> ] 117.7MB/247.9MB d392064e98fe Downloading [===========================> ] 137.7MB/247.9MB d392064e98fe Downloading [=================================> ] 163.9MB/247.9MB d392064e98fe Downloading [=====================================> ] 188.3MB/247.9MB d392064e98fe Downloading [=============================================> ] 225MB/247.9MB d392064e98fe Verifying Checksum d392064e98fe Download complete 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer 8ee087424735 Retrying in 8 seconds 95fbdc905868 Download complete d392064e98fe Download complete 14a2db583838 Download complete f56c561313a5 Download complete 6a9107c62552 Download complete 6f2ba4009a06 Download complete 8bd1c9b32ce1 Download complete 419ba6210003 Download complete 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB unexpected EOF (cluster.py:2709, logging_pulling_images) 2025-07-09 22:01:19 [ 674 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: upstream_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: old_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 95fbdc905868 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 14a2db583838 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6a9107c62552 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 419ba6210003 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: upstream_node Pulled (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 95fbdc905868 Downloading [> ] 125.2kB/9.576MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 95fbdc905868 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [> ] 524.4kB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=======> ] 38.68MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=================> ] 88.26MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [===========================> ] 135.1MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [====================================> ] 179.1MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [===========================================> ] 218.1MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 14a2db583838 Downloading [==================================================>] 92B/92B (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 14a2db583838 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [========> ] 3.646kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6a9107c62552 Downloading [> ] 13.78kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6a9107c62552 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Downloading [==================================================>] 149B/149B (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 419ba6210003 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Stderr:unexpected EOF (cluster.py:147, run_and_check) 2025-07-09 22:03:29 [ 674 ] DEBUG : Exitcode:18 (cluster.py:149, run_and_check) 2025-07-09 22:03:29 [ 674 ] INFO : Got exception pulling images: Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: upstream_node Pulling old_node Pulling 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer 8ee087424735 Waiting 95fbdc905868 Waiting d392064e98fe Waiting 14a2db583838 Waiting f56c561313a5 Waiting 6a9107c62552 Waiting 6f2ba4009a06 Waiting 8bd1c9b32ce1 Waiting 419ba6210003 Waiting upstream_node Pulled 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 95fbdc905868 Downloading [> ] 125.2kB/9.576MB 95fbdc905868 Verifying Checksum 95fbdc905868 Download complete d392064e98fe Downloading [> ] 524.4kB/247.9MB d392064e98fe Downloading [=======> ] 38.68MB/247.9MB d392064e98fe Downloading [=================> ] 88.26MB/247.9MB d392064e98fe Downloading [===========================> ] 135.1MB/247.9MB d392064e98fe Downloading [====================================> ] 179.1MB/247.9MB d392064e98fe Downloading [===========================================> ] 218.1MB/247.9MB d392064e98fe Verifying Checksum d392064e98fe Download complete 14a2db583838 Downloading [==================================================>] 92B/92B 14a2db583838 Verifying Checksum 14a2db583838 Download complete f56c561313a5 Downloading [========> ] 3.646kB/22.5kB f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB f56c561313a5 Verifying Checksum f56c561313a5 Download complete 6a9107c62552 Downloading [> ] 13.78kB/863.5kB 6a9107c62552 Verifying Checksum 6a9107c62552 Download complete 6f2ba4009a06 Downloading [==================================================>] 149B/149B 6f2ba4009a06 Verifying Checksum 6f2ba4009a06 Download complete 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B 8bd1c9b32ce1 Verifying Checksum 8bd1c9b32ce1 Download complete 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB 419ba6210003 Verifying Checksum 419ba6210003 Download complete 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer f56c561313a5 Download complete 6a9107c62552 Download complete 6f2ba4009a06 Download complete 8bd1c9b32ce1 Download complete 419ba6210003 Download complete 8ee087424735 Retrying in 11 seconds 14a2db583838 Download complete 95fbdc905868 Download complete d392064e98fe Download complete 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB unexpected EOF (cluster.py:2709, logging_pulling_images) 2025-07-09 22:03:32 [ 674 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: old_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: upstream_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: upstream_node Pulled (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 14a2db583838 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: f56c561313a5 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6a9107c62552 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 419ba6210003 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 95fbdc905868 Downloading [> ] 100.7kB/9.576MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [> ] 530.6kB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 95fbdc905868 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 14a2db583838 Downloading [==================================================>] 92B/92B (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 14a2db583838 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [========> ] 3.646kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6a9107c62552 Downloading [> ] 13.78kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6a9107c62552 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Downloading [==================================================>] 149B/149B (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 419ba6210003 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [======> ] 30.97MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [==============> ] 72.2MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [======================> ] 112.3MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=============================> ] 148.5MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [====================================> ] 179.2MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [==========================================> ] 210.3MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Stderr:unexpected EOF (cluster.py:147, run_and_check) 2025-07-09 22:05:35 [ 674 ] DEBUG : Exitcode:18 (cluster.py:149, run_and_check) 2025-07-09 22:05:35 [ 674 ] INFO : Got exception pulling images: Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: old_node Pulling upstream_node Pulling upstream_node Pulled 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer 14a2db583838 Waiting f56c561313a5 Waiting 6a9107c62552 Waiting 6f2ba4009a06 Waiting 8bd1c9b32ce1 Waiting 419ba6210003 Waiting 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 5 seconds 95fbdc905868 Downloading [> ] 100.7kB/9.576MB d392064e98fe Downloading [> ] 530.6kB/247.9MB 95fbdc905868 Verifying Checksum 95fbdc905868 Download complete 14a2db583838 Downloading [==================================================>] 92B/92B 14a2db583838 Verifying Checksum 14a2db583838 Download complete f56c561313a5 Downloading [========> ] 3.646kB/22.5kB f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB 6a9107c62552 Downloading [> ] 13.78kB/863.5kB 6a9107c62552 Verifying Checksum 6a9107c62552 Download complete 6f2ba4009a06 Downloading [==================================================>] 149B/149B 6f2ba4009a06 Verifying Checksum 6f2ba4009a06 Download complete 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B 8bd1c9b32ce1 Verifying Checksum 8bd1c9b32ce1 Download complete 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB 419ba6210003 Verifying Checksum 419ba6210003 Download complete d392064e98fe Downloading [======> ] 30.97MB/247.9MB d392064e98fe Downloading [==============> ] 72.2MB/247.9MB d392064e98fe Downloading [======================> ] 112.3MB/247.9MB d392064e98fe Downloading [=============================> ] 148.5MB/247.9MB d392064e98fe Downloading [====================================> ] 179.2MB/247.9MB d392064e98fe Downloading [==========================================> ] 210.3MB/247.9MB d392064e98fe Verifying Checksum d392064e98fe Download complete 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB f56c561313a5 Download complete 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer f56c561313a5 Download complete 6a9107c62552 Download complete 6f2ba4009a06 Download complete 8bd1c9b32ce1 Download complete 419ba6210003 Download complete 95fbdc905868 Download complete 8ee087424735 Retrying in 11 seconds d392064e98fe Download complete 14a2db583838 Download complete 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB unexpected EOF (cluster.py:2709, logging_pulling_images) 2025-07-09 22:05:38 [ 674 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: old_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: upstream_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: upstream_node Pulled (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6a9107c62552 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 419ba6210003 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 14a2db583838 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [> ] 536.9kB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 95fbdc905868 Downloading [> ] 100.7kB/9.576MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 95fbdc905868 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 14a2db583838 Downloading [==================================================>] 92B/92B (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [========> ] 3.646kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6a9107c62552 Downloading [> ] 10.88kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Downloading [==================================================>] 149B/149B (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 419ba6210003 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [======> ] 31.16MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [============> ] 59.57MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=================> ] 89.1MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [===========================> ] 135.3MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [================================> ] 162.6MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [======================================> ] 189.9MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [============================================> ] 218.9MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Stderr:unexpected EOF (cluster.py:147, run_and_check) 2025-07-09 22:07:42 [ 674 ] DEBUG : Exitcode:18 (cluster.py:149, run_and_check) 2025-07-09 22:07:42 [ 674 ] INFO : Got exception pulling images: Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: old_node Pulling upstream_node Pulling upstream_node Pulled 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer f56c561313a5 Waiting 6a9107c62552 Waiting 6f2ba4009a06 Waiting 8bd1c9b32ce1 Waiting 419ba6210003 Waiting 14a2db583838 Waiting 8ee087424735 Retrying in 5 seconds d392064e98fe Downloading [> ] 536.9kB/247.9MB 95fbdc905868 Downloading [> ] 100.7kB/9.576MB 95fbdc905868 Verifying Checksum 95fbdc905868 Download complete 14a2db583838 Downloading [==================================================>] 92B/92B 14a2db583838 Download complete f56c561313a5 Downloading [========> ] 3.646kB/22.5kB f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB f56c561313a5 Verifying Checksum f56c561313a5 Download complete 6a9107c62552 Downloading [> ] 10.88kB/863.5kB 6a9107c62552 Download complete 6f2ba4009a06 Downloading [==================================================>] 149B/149B 6f2ba4009a06 Download complete 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B 8bd1c9b32ce1 Verifying Checksum 8bd1c9b32ce1 Download complete 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB 419ba6210003 Verifying Checksum 419ba6210003 Download complete d392064e98fe Downloading [======> ] 31.16MB/247.9MB d392064e98fe Downloading [============> ] 59.57MB/247.9MB d392064e98fe Downloading [=================> ] 89.1MB/247.9MB d392064e98fe Downloading [===========================> ] 135.3MB/247.9MB d392064e98fe Downloading [================================> ] 162.6MB/247.9MB d392064e98fe Downloading [======================================> ] 189.9MB/247.9MB d392064e98fe Downloading [============================================> ] 218.9MB/247.9MB d392064e98fe Verifying Checksum d392064e98fe Download complete 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer 8ee087424735 Retrying in 12 seconds f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer 95fbdc905868 Download complete d392064e98fe Download complete 14a2db583838 Download complete f56c561313a5 Download complete 6a9107c62552 Download complete 6f2ba4009a06 Download complete 8bd1c9b32ce1 Download complete 419ba6210003 Download complete 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB unexpected EOF (cluster.py:2709, logging_pulling_images) 2025-07-09 22:07:46 [ 674 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: old_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: upstream_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: upstream_node Pulled (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 14a2db583838 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6a9107c62552 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 419ba6210003 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 95fbdc905868 Downloading [> ] 100.7kB/9.576MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [> ] 524.9kB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 95fbdc905868 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 14a2db583838 Downloading [==================================================>] 92B/92B (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 14a2db583838 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [========> ] 3.646kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6a9107c62552 Downloading [> ] 13.78kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Downloading [==================================================>] 149B/149B (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 419ba6210003 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=====> ] 29.29MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [============> ] 64.38MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [===================> ] 96.13MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=========================> ] 126.2MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [===============================> ] 157.4MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=======================================> ] 194.2MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Downloading [=============================================> ] 226.5MB/247.9MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 20 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 95fbdc905868 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 14a2db583838 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6a9107c62552 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 419ba6210003 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: f56c561313a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 95fbdc905868 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: d392064e98fe Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 14a2db583838 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6f2ba4009a06 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 6a9107c62552 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8bd1c9b32ce1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 419ba6210003 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 19 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 18 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 17 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 16 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 15 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 14 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 13 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 12 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 11 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 10 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 9 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 8 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 7 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 6 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 5 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 4 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 3 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 2 seconds (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Retrying in 1 second (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr: 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stderr:unexpected EOF (cluster.py:147, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Exitcode:18 (cluster.py:149, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Failed to start cluster: (cluster.py:3091, start) 2025-07-09 22:09:52 [ 674 ] DEBUG : Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: old_node Pulling upstream_node Pulling upstream_node Pulled 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer 14a2db583838 Waiting f56c561313a5 Waiting 6a9107c62552 Waiting 6f2ba4009a06 Waiting 8bd1c9b32ce1 Waiting 419ba6210003 Waiting 8ee087424735 Retrying in 5 seconds 95fbdc905868 Downloading [> ] 100.7kB/9.576MB d392064e98fe Downloading [> ] 524.9kB/247.9MB 95fbdc905868 Verifying Checksum 95fbdc905868 Download complete 14a2db583838 Downloading [==================================================>] 92B/92B 14a2db583838 Verifying Checksum 14a2db583838 Download complete f56c561313a5 Downloading [========> ] 3.646kB/22.5kB f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB f56c561313a5 Verifying Checksum f56c561313a5 Download complete 6a9107c62552 Downloading [> ] 13.78kB/863.5kB 6a9107c62552 Download complete 6f2ba4009a06 Downloading [==================================================>] 149B/149B 6f2ba4009a06 Download complete 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B 8bd1c9b32ce1 Verifying Checksum 8bd1c9b32ce1 Download complete 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB 419ba6210003 Verifying Checksum 419ba6210003 Download complete d392064e98fe Downloading [=====> ] 29.29MB/247.9MB d392064e98fe Downloading [============> ] 64.38MB/247.9MB d392064e98fe Downloading [===================> ] 96.13MB/247.9MB d392064e98fe Downloading [=========================> ] 126.2MB/247.9MB d392064e98fe Downloading [===============================> ] 157.4MB/247.9MB d392064e98fe Downloading [=======================================> ] 194.2MB/247.9MB d392064e98fe Downloading [=============================================> ] 226.5MB/247.9MB d392064e98fe Verifying Checksum d392064e98fe Download complete 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer f56c561313a5 Download complete 8ee087424735 Retrying in 13 seconds 95fbdc905868 Download complete d392064e98fe Download complete 14a2db583838 Download complete 6f2ba4009a06 Download complete 6a9107c62552 Download complete 8bd1c9b32ce1 Download complete 419ba6210003 Download complete 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB unexpected EOF (cluster.py:3092, start) 2025-07-09 22:09:52 [ 674 ] DEBUG : Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2713, in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 27, in inner raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 20, in inner func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 153, in run_and_check raise Exception( Exception: Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: old_node Pulling upstream_node Pulling upstream_node Pulled 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer 14a2db583838 Waiting f56c561313a5 Waiting 6a9107c62552 Waiting 6f2ba4009a06 Waiting 8bd1c9b32ce1 Waiting 419ba6210003 Waiting 8ee087424735 Retrying in 5 seconds 95fbdc905868 Downloading [> ] 100.7kB/9.576MB d392064e98fe Downloading [> ] 524.9kB/247.9MB 95fbdc905868 Verifying Checksum 95fbdc905868 Download complete 14a2db583838 Downloading [==================================================>] 92B/92B 14a2db583838 Verifying Checksum 14a2db583838 Download complete f56c561313a5 Downloading [========> ] 3.646kB/22.5kB f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB f56c561313a5 Verifying Checksum f56c561313a5 Download complete 6a9107c62552 Downloading [> ] 13.78kB/863.5kB 6a9107c62552 Download complete 6f2ba4009a06 Downloading [==================================================>] 149B/149B 6f2ba4009a06 Download complete 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B 8bd1c9b32ce1 Verifying Checksum 8bd1c9b32ce1 Download complete 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB 419ba6210003 Verifying Checksum 419ba6210003 Download complete d392064e98fe Downloading [=====> ] 29.29MB/247.9MB d392064e98fe Downloading [============> ] 64.38MB/247.9MB d392064e98fe Downloading [===================> ] 96.13MB/247.9MB d392064e98fe Downloading [=========================> ] 126.2MB/247.9MB d392064e98fe Downloading [===============================> ] 157.4MB/247.9MB d392064e98fe Downloading [=======================================> ] 194.2MB/247.9MB d392064e98fe Downloading [=============================================> ] 226.5MB/247.9MB d392064e98fe Verifying Checksum d392064e98fe Download complete 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 20 seconds 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Pulling fs layer 95fbdc905868 Pulling fs layer d392064e98fe Pulling fs layer 14a2db583838 Pulling fs layer f56c561313a5 Pulling fs layer 6a9107c62552 Pulling fs layer 6f2ba4009a06 Pulling fs layer 8bd1c9b32ce1 Pulling fs layer 419ba6210003 Pulling fs layer f56c561313a5 Download complete 8ee087424735 Retrying in 13 seconds 95fbdc905868 Download complete d392064e98fe Download complete 14a2db583838 Download complete 6f2ba4009a06 Download complete 6a9107c62552 Download complete 8bd1c9b32ce1 Download complete 419ba6210003 Download complete 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB 8ee087424735 Retrying in 19 seconds 8ee087424735 Retrying in 18 seconds 8ee087424735 Retrying in 17 seconds 8ee087424735 Retrying in 16 seconds 8ee087424735 Retrying in 15 seconds 8ee087424735 Retrying in 14 seconds 8ee087424735 Retrying in 13 seconds 8ee087424735 Retrying in 12 seconds 8ee087424735 Retrying in 11 seconds 8ee087424735 Retrying in 10 seconds 8ee087424735 Retrying in 9 seconds 8ee087424735 Retrying in 8 seconds 8ee087424735 Retrying in 7 seconds 8ee087424735 Retrying in 6 seconds 8ee087424735 Retrying in 5 seconds 8ee087424735 Retrying in 4 seconds 8ee087424735 Retrying in 3 seconds 8ee087424735 Retrying in 2 seconds 8ee087424735 Retrying in 1 second 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB unexpected EOF (cluster.py:3093, start) 2025-07-09 22:09:52 [ 674 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-09 22:09:52 [ 674 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Docker networks for project roottestbackwardcompatibilityinsertprofileevents-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:09:52 [ 674 ] DEBUG : Docker containers for project roottestbackwardcompatibilityinsertprofileevents-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:09:52 [ 674 ] DEBUG : Docker volumes for project roottestbackwardcompatibilityinsertprofileevents-gw5 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:09:52 [ 674 ] DEBUG : Command:[docker container list --all --filter name='^/roottestbackwardcompatibilityinsertprofileevents-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : No running containers for project: roottestbackwardcompatibilityinsertprofileevents-gw5 (cluster.py:874, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-07-09 22:09:52 [ 674 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-09 22:09:52 [ 674 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Docker networks for project roottestbackwardcompatibilityinsertprofileevents-gw5 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:09:52 [ 674 ] DEBUG : Docker containers for project roottestbackwardcompatibilityinsertprofileevents-gw5 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:09:52 [ 674 ] DEBUG : Docker volumes for project roottestbackwardcompatibilityinsertprofileevents-gw5 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:09:52 [ 674 ] DEBUG : Command:[docker container list --all --filter name='^/roottestbackwardcompatibilityinsertprofileevents-gw5-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : No running containers for project: roottestbackwardcompatibilityinsertprofileevents-gw5 (cluster.py:874, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-09 22:09:52 [ 674 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-09 22:09:52 [ 674 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) _________________ ERROR at setup of test_old_client_compatible _________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def start_cluster(): try: > cluster.start() test_backward_compatibility/test_insert_profile_events.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:27: in inner raise e helpers/retry_decorator.py:20: in inner func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env', '--project-name', 'roottestbackwardcompatibilityinsertprofileevents-gw5', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args: Union[Sequence[str], str], env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ) -> str: if shell: if isinstance(args, str): shell_args = args else: shell_args = next(a for a in args) else: shell_args = " ".join(args) logging.debug("Command:[%s]", shell_args) if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return "" res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout, check=False, ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug("Stdout:%s", outline) for errline in err.splitlines(): logging.debug("Stderr:%s", errline) if res.returncode != 0: logging.debug("Exitcode:%s", res.returncode) if env: logging.debug("Env:%s", env) if not nothrow: > raise Exception( f"Command [{shell_args}] return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command [docker compose --env-file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/.env --project-name roottestbackwardcompatibilityinsertprofileevents-gw5 --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/upstream_node/docker-compose.yml --file /ClickHouse/tests/integration/test_backward_compatibility/_instances-insert_profile_events-0-gw5/old_node/docker-compose.yml pull] return non-zero code 18: old_node Pulling E upstream_node Pulling E upstream_node Pulled E 8ee087424735 Pulling fs layer E 95fbdc905868 Pulling fs layer E d392064e98fe Pulling fs layer E 14a2db583838 Pulling fs layer E f56c561313a5 Pulling fs layer E 6a9107c62552 Pulling fs layer E 6f2ba4009a06 Pulling fs layer E 8bd1c9b32ce1 Pulling fs layer E 419ba6210003 Pulling fs layer E 14a2db583838 Waiting E f56c561313a5 Waiting E 6a9107c62552 Waiting E 6f2ba4009a06 Waiting E 8bd1c9b32ce1 Waiting E 419ba6210003 Waiting E 8ee087424735 Retrying in 5 seconds E 95fbdc905868 Downloading [> ] 100.7kB/9.576MB E d392064e98fe Downloading [> ] 524.9kB/247.9MB E 95fbdc905868 Verifying Checksum E 95fbdc905868 Download complete E 14a2db583838 Downloading [==================================================>] 92B/92B E 14a2db583838 Verifying Checksum E 14a2db583838 Download complete E f56c561313a5 Downloading [========> ] 3.646kB/22.5kB E f56c561313a5 Downloading [==================================================>] 22.5kB/22.5kB E f56c561313a5 Verifying Checksum E f56c561313a5 Download complete E 6a9107c62552 Downloading [> ] 13.78kB/863.5kB E 6a9107c62552 Download complete E 6f2ba4009a06 Downloading [==================================================>] 149B/149B E 6f2ba4009a06 Download complete E 8bd1c9b32ce1 Downloading [==================================================>] 363B/363B E 8bd1c9b32ce1 Verifying Checksum E 8bd1c9b32ce1 Download complete E 419ba6210003 Downloading [==================================================>] 2.876kB/2.876kB E 419ba6210003 Verifying Checksum E 419ba6210003 Download complete E d392064e98fe Downloading [=====> ] 29.29MB/247.9MB E d392064e98fe Downloading [============> ] 64.38MB/247.9MB E d392064e98fe Downloading [===================> ] 96.13MB/247.9MB E d392064e98fe Downloading [=========================> ] 126.2MB/247.9MB E d392064e98fe Downloading [===============================> ] 157.4MB/247.9MB E d392064e98fe Downloading [=======================================> ] 194.2MB/247.9MB E d392064e98fe Downloading [=============================================> ] 226.5MB/247.9MB E d392064e98fe Verifying Checksum E d392064e98fe Download complete E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 15 seconds E 8ee087424735 Retrying in 14 seconds E 8ee087424735 Retrying in 13 seconds E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 20 seconds E 8ee087424735 Retrying in 19 seconds E 8ee087424735 Retrying in 18 seconds E 8ee087424735 Retrying in 17 seconds E 8ee087424735 Retrying in 16 seconds E 8ee087424735 Retrying in 15 seconds E 8ee087424735 Retrying in 14 seconds E 8ee087424735 Retrying in 13 seconds E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Pulling fs layer E 95fbdc905868 Pulling fs layer E d392064e98fe Pulling fs layer E 14a2db583838 Pulling fs layer E f56c561313a5 Pulling fs layer E 6a9107c62552 Pulling fs layer E 6f2ba4009a06 Pulling fs layer E 8bd1c9b32ce1 Pulling fs layer E 419ba6210003 Pulling fs layer E f56c561313a5 Download complete E 8ee087424735 Retrying in 13 seconds E 95fbdc905868 Download complete E d392064e98fe Download complete E 14a2db583838 Download complete E 6f2ba4009a06 Download complete E 6a9107c62552 Download complete E 8bd1c9b32ce1 Download complete E 419ba6210003 Download complete E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E 8ee087424735 Retrying in 19 seconds E 8ee087424735 Retrying in 18 seconds E 8ee087424735 Retrying in 17 seconds E 8ee087424735 Retrying in 16 seconds E 8ee087424735 Retrying in 15 seconds E 8ee087424735 Retrying in 14 seconds E 8ee087424735 Retrying in 13 seconds E 8ee087424735 Retrying in 12 seconds E 8ee087424735 Retrying in 11 seconds E 8ee087424735 Retrying in 10 seconds E 8ee087424735 Retrying in 9 seconds E 8ee087424735 Retrying in 8 seconds E 8ee087424735 Retrying in 7 seconds E 8ee087424735 Retrying in 6 seconds E 8ee087424735 Retrying in 5 seconds E 8ee087424735 Retrying in 4 seconds E 8ee087424735 Retrying in 3 seconds E 8ee087424735 Retrying in 2 seconds E 8ee087424735 Retrying in 1 second E 8ee087424735 Downloading [==================================================>] 27.51MB/27.51MB E unexpected EOF helpers/cluster.py:153: Exception =================================== FAILURES =================================== ___________________________ test_different_versions ____________________________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 def test_different_versions(): new_node.query( "CREATE TABLE tbl" " ON CLUSTER 'cluster_ver'" " (x UInt64) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}')" " ORDER BY tuple()" ) new_node.query(f"INSERT INTO tbl VALUES (1)") old_node.query(f"INSERT INTO tbl VALUES (2)") backup_name = new_backup_name() initiator = random_node() print(f"Using {get_node_name(initiator)} as initiator for BACKUP") initiator.query(f"BACKUP TABLE tbl ON CLUSTER 'cluster_ver' TO {backup_name}") new_node.query("DROP TABLE tbl ON CLUSTER 'cluster_ver' SYNC") initiator = random_node() print(f"Using {get_node_name(initiator)} as initiator for RESTORE") initiator.query(f"RESTORE TABLE tbl ON CLUSTER 'cluster_ver' FROM {backup_name}") new_node.query("SYSTEM SYNC REPLICA ON CLUSTER 'cluster_ver' tbl") assert new_node.query("SELECT * FROM tbl ORDER BY x") == TSV([1, 2]) assert old_node.query("SELECT * FROM tbl ORDER BY x") == TSV([1, 2]) # Error NO_ELEMENTS_IN_CONFIG is unrelated. > assert ( new_node.query( "SELECT name, last_error_message FROM system.errors WHERE NOT (" "(name == 'NO_ELEMENTS_IN_CONFIG')" ")" ) == "" ) E assert "NETLINK_ERROR\tCan\\'t receive Netlink response: error -2\n" == '' E + NETLINK_ERROR Can\'t receive Netlink response: error -2 test_backup_restore_on_cluster/test_different_versions.py:105: AssertionError ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2025-07-09 22:00:16 [ 656 ] INFO : Running tests in /ClickHouse/tests/integration/test_backup_restore_on_cluster/test_different_versions.py (cluster.py:2672, start) 2025-07-09 22:00:16 [ 656 ] DEBUG : Cluster start called. is_up=False (cluster.py:2679, start) 2025-07-09 22:00:17 [ 656 ] DEBUG : Docker networks for project roottestbackuprestoreonclusterdifferentversions-gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:00:17 [ 656 ] DEBUG : Docker containers for project roottestbackuprestoreonclusterdifferentversions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:00:17 [ 656 ] DEBUG : Docker volumes for project roottestbackuprestoreonclusterdifferentversions-gw4 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:00:17 [ 656 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : Docker networks for project roottestbackuprestoreonclusterdifferentversions-gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:00:17 [ 656 ] DEBUG : Docker containers for project roottestbackuprestoreonclusterdifferentversions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:00:17 [ 656 ] DEBUG : Docker volumes for project roottestbackuprestoreonclusterdifferentversions-gw4 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:00:17 [ 656 ] DEBUG : Command:[docker container list --all --filter name='^/roottestbackuprestoreonclusterdifferentversions-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-09 22:00:17 [ 656 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : No running containers for project: roottestbackuprestoreonclusterdifferentversions-gw4 (cluster.py:874, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:00:17 [ 656 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:00:17 [ 656 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-09 22:00:17 [ 656 ] DEBUG : Stdout:2 (cluster.py:145, run_and_check) 2025-07-09 22:00:17 [ 656 ] DEBUG : Command:[docker volume prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:00:17 [ 656 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:00:17 [ 656 ] DEBUG : Volumes pruned: 2 (cluster.py:910, cleanup) 2025-07-09 22:00:17 [ 656 ] DEBUG : Setup directory for instance: new_node (cluster.py:2692, start) 2025-07-09 22:00:17 [ 656 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_backup_restore_on_cluster/configs/backups_disk.xml', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/configs/cluster_different_versions.xml'] to /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/configs/config.d (cluster.py:4649, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/database (cluster.py:4666, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/logs (cluster.py:4677, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-09 22:00:17 [ 656 ] INFO : external_dir_abs_path=/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/backups (cluster.py:4787, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Setup directory for instance: old_node (cluster.py:2692, start) 2025-07-09 22:00:17 [ 656 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_backup_restore_on_cluster/configs/backups_disk.xml', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/configs/cluster_different_versions.xml'] to /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/configs/config.d (cluster.py:4649, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/database (cluster.py:4666, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/logs (cluster.py:4677, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-09 22:00:17 [ 656 ] INFO : external_dir_abs_path=/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/backups (cluster.py:4787, create_dir) 2025-07-09 22:00:17 [ 656 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:5ccda723c1fc', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/.env (cluster.py:96, _create_env_file) 2025-07-09 22:00:17 [ 656 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-09 22:00:17 [ 656 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-09 22:00:17 [ 656 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-09 22:00:17 [ 656 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-09 22:00:17 [ 656 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-07-09 22:00:17 [ 656 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/.env --project-name roottestbackuprestoreonclusterdifferentversions-gw4 --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: new_node Skipped - Image is already being pulled by zoo3 (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: zoo1 Skipped - Image is already being pulled by zoo3 (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: zoo2 Skipped - Image is already being pulled by zoo3 (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: old_node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: zoo3 Pulling (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: zoo3 Pulled (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: fd4d333a83bf Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Pulling fs layer (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: fd4d333a83bf Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Waiting (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Downloading [> ] 275.9kB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Downloading [> ] 109.3kB/8.803MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [> ] 294.9kB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Downloading [==================================================>] 32B/32B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Downloading [> ] 532.2kB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [=====> ] 2.949MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Downloading [==========> ] 30.42MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [=========> ] 5.308MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Downloading [===========================> ] 79.81MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Downloading [=======> ] 3.646kB/25.48kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Downloading [==================================================>] 25.48kB/25.48kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Downloading [> ] 13.78kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Downloading [==================================================>] 863.5kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Downloading [==================================================>] 116B/116B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: fd4d333a83bf Downloading [==================================================>] 368B/368B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: fd4d333a83bf Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Downloading [==================================================>] 3.112kB/3.112kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [==============> ] 7.963MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Downloading [==========================================> ] 122.7MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Verifying Checksum (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Download complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [==================> ] 10.03MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [==========================> ] 14.45MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [=====================================> ] 20.64MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [==========================================> ] 23.3MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [================================================> ] 26.54MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Extracting [==================================================>] 27.51MB/27.51MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3823320faa42 Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Extracting [> ] 98.3kB/8.803MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Extracting [================> ] 2.949MB/8.803MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Extracting [====================================> ] 6.39MB/8.803MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Extracting [=============================================> ] 8.061MB/8.803MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Extracting [===============================================> ] 8.356MB/8.803MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Extracting [==================================================>] 8.803MB/8.803MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 9992e46614b1 Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Extracting [==================================================>] 32B/32B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Extracting [==================================================>] 32B/32B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 4f4fb700ef54 Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [> ] 557.1kB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [==> ] 7.242MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [=====> ] 16.15MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [========> ] 24.51MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [==========> ] 31.2MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [=============> ] 37.88MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [===============> ] 44.56MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [=================> ] 50.14MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [===================> ] 56.26MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [=====================> ] 62.39MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [======================> ] 66.29MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [========================> ] 70.75MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [=========================> ] 74.09MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [===========================> ] 78.54MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [============================> ] 83MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [==============================> ] 88.57MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [================================> ] 94.7MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [==================================> ] 100.8MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [====================================> ] 106.4MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [======================================> ] 112MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [========================================> ] 116.4MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [==========================================> ] 123.7MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [=============================================> ] 130.9MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [===============================================> ] 135.9MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [================================================> ] 139.3MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [================================================> ] 140.9MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [=================================================> ] 142.6MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Extracting [==================================================>] 144.2MB/144.2MB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: cfd7763775f9 Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Extracting [==================================================>] 25.48kB/25.48kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: a517e5e9f3cd Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Extracting [=> ] 32.77kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Extracting [==================================================>] 863.5kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Extracting [==================================================>] 863.5kB/863.5kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3ce37c9627a5 Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Extracting [==================================================>] 116B/116B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Extracting [==================================================>] 116B/116B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 3f8a7f45c802 Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: fd4d333a83bf Extracting [==================================================>] 368B/368B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: fd4d333a83bf Extracting [==================================================>] 368B/368B (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: fd4d333a83bf Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Extracting [==================================================>] 3.112kB/3.112kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Extracting [==================================================>] 3.112kB/3.112kB (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: 12e84a19c313 Pull complete (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Stderr: old_node Pulled (cluster.py:147, run_and_check) 2025-07-09 22:00:32 [ 656 ] DEBUG : Setup ZooKeeper (cluster.py:2733, start) 2025-07-09 22:00:32 [ 656 ] DEBUG : Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper1/log', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper1/config', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper1/coordination', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper2/log', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper2/config', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper2/coordination', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper3/log', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper3/config', '/ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/keeper3/coordination'] (cluster.py:2734, start) 2025-07-09 22:00:32 [ 656 ] DEBUG : Command:[docker compose --project-name roottestbackuprestoreonclusterdifferentversions-gw4 --env-file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --verbose up -d] (cluster.py:121, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr:time="2025-07-09T22:00:32Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Network roottestbackuprestoreonclusterdifferentversions-gw4_default Creating (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Network roottestbackuprestoreonclusterdifferentversions-gw4_default Created (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Creating (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Creating (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Creating (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Created (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Created (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Created (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Starting (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Starting (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Starting (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Started (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Started (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Started (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr:time="2025-07-09T22:00:33Z" level=debug msg="otel error" error="" (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Stderr:time="2025-07-09T22:00:33Z" level=debug msg="otel error" error="" (cluster.py:147, run_and_check) 2025-07-09 22:00:33 [ 656 ] DEBUG : Wait ZooKeeper to start (cluster.py:2398, wait_zookeeper_to_start) 2025-07-09 22:00:33 [ 656 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:1999, get_instance_ip) 2025-07-09 22:00:33 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:33 [ 656 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.1.2, port:2181, use_ssl:False (cluster.py:3234, get_kazoo_client) 2025-07-09 22:00:33 [ 656 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:33 [ 656 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-07-09 22:00:33 [ 656 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:33 [ 656 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-07-09 22:00:33 [ 656 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:33 [ 656 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-07-09 22:00:34 [ 656 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:34 [ 656 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-07-09 22:00:34 [ 656 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:34 [ 656 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-07-09 22:00:36 [ 656 ] INFO : Connecting to 172.16.1.2(172.16.1.2):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:36 [ 656 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-07-09 22:00:36 [ 656 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-07-09 22:00:36 [ 656 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-07-09 22:00:36 [ 656 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-07-09 22:00:36 [ 656 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-07-09 22:00:36 [ 656 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-07-09 22:00:36 [ 656 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-07-09 22:00:36 [ 656 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-07-09 22:00:36 [ 656 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-07-09 22:00:36 [ 656 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-07-09 22:00:36 [ 656 ] DEBUG : get_instance_ip instance_name=zoo2 (cluster.py:1999, get_instance_ip) 2025-07-09 22:00:36 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:36 [ 656 ] DEBUG : get_kazoo_client: zoo2, ip:172.16.1.3, port:2181, use_ssl:False (cluster.py:3234, get_kazoo_client) 2025-07-09 22:00:36 [ 656 ] INFO : Connecting to 172.16.1.3(172.16.1.3):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:36 [ 656 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-07-09 22:00:36 [ 656 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-07-09 22:00:36 [ 656 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-07-09 22:00:36 [ 656 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-07-09 22:00:36 [ 656 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-07-09 22:00:36 [ 656 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-07-09 22:00:36 [ 656 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-07-09 22:00:36 [ 656 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-07-09 22:00:36 [ 656 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-07-09 22:00:36 [ 656 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-07-09 22:00:36 [ 656 ] DEBUG : get_instance_ip instance_name=zoo3 (cluster.py:1999, get_instance_ip) 2025-07-09 22:00:36 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:36 [ 656 ] DEBUG : get_kazoo_client: zoo3, ip:172.16.1.4, port:2181, use_ssl:False (cluster.py:3234, get_kazoo_client) 2025-07-09 22:00:37 [ 656 ] INFO : Connecting to 172.16.1.4(172.16.1.4):2181, use_ssl: False (connection.py:650, _connect) 2025-07-09 22:00:37 [ 656 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-07-09 22:00:37 [ 656 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-07-09 22:00:37 [ 656 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-07-09 22:00:37 [ 656 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-07-09 22:00:37 [ 656 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-07-09 22:00:37 [ 656 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-07-09 22:00:37 [ 656 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-07-09 22:00:37 [ 656 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-07-09 22:00:37 [ 656 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-07-09 22:00:37 [ 656 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-07-09 22:00:37 [ 656 ] DEBUG : All instances of ZooKeeper started: ('zoo1', 'zoo2', 'zoo3') (cluster.py:2414, wait_zookeeper_nodes_to_start) 2025-07-09 22:00:37 [ 656 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/.env --project-name roottestbackuprestoreonclusterdifferentversions-gw4 --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/docker-compose.yml up -d --no-recreate') (cluster.py:3061, start) 2025-07-09 22:00:37 [ 656 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/.env --project-name roottestbackuprestoreonclusterdifferentversions-gw4 --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/docker-compose.yml up -d --no-recreate] (cluster.py:121, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Running (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Running (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Running (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Creating (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Creating (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Created (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Created (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Starting (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Starting (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Started (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Started (cluster.py:147, run_and_check) 2025-07-09 22:00:37 [ 656 ] DEBUG : ClickHouse instance created (cluster.py:3069, start) 2025-07-09 22:00:37 [ 656 ] DEBUG : get_instance_ip instance_name=new_node (cluster.py:1999, get_instance_ip) 2025-07-09 22:00:37 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:37 [ 656 ] DEBUG : get_instance_ip instance_name=new_node (cluster.py:2009, get_instance_global_ipv6) 2025-07-09 22:00:37 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:37 [ 656 ] DEBUG : Waiting for ClickHouse start in new_node, ip: 172.16.1.6... (cluster.py:3077, start) 2025-07-09 22:00:37 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:37 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:37 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:37 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:38 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:39 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:39 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/3e2580481bc546c36fb71dd2296d17bf084a83055170fad42eb861ce15e4bfe2/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:39 [ 656 ] DEBUG : ClickHouse new_node started (cluster.py:3081, start) 2025-07-09 22:00:39 [ 656 ] DEBUG : get_instance_ip instance_name=old_node (cluster.py:1999, get_instance_ip) 2025-07-09 22:00:39 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:39 [ 656 ] DEBUG : get_instance_ip instance_name=old_node (cluster.py:2009, get_instance_global_ipv6) 2025-07-09 22:00:39 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:39 [ 656 ] DEBUG : Waiting for ClickHouse start in old_node, ip: 172.16.1.5... (cluster.py:3077, start) 2025-07-09 22:00:39 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:39 [ 656 ] DEBUG : http://localhost:None "GET /v1.46/containers/5ef39b4ce33864374ba28e9622a5e47cd67771c748ffa9784510cbb915ac85aa/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:00:39 [ 656 ] DEBUG : ClickHouse old_node started (cluster.py:3081, start) ----------------------------- Captured stdout call ----------------------------- Using old_node as initiator for BACKUP Using new_node as initiator for RESTORE ------------------------------ Captured log call ------------------------------- 2025-07-09 22:00:39 [ 656 ] DEBUG : Executing query CREATE TABLE tbl ON CLUSTER 'cluster_ver' (x UInt64) ENGINE=ReplicatedMergeTree('/clickhouse/tables/tbl/', '{replica}') ORDER BY tuple() on new_node (cluster.py:3570, query) 2025-07-09 22:00:39 [ 656 ] DEBUG : Executing query INSERT INTO tbl VALUES (1) on new_node (cluster.py:3570, query) 2025-07-09 22:00:39 [ 656 ] DEBUG : Executing query INSERT INTO tbl VALUES (2) on old_node (cluster.py:3570, query) 2025-07-09 22:00:40 [ 656 ] DEBUG : Executing query BACKUP TABLE tbl ON CLUSTER 'cluster_ver' TO Disk('backups', '1') on old_node (cluster.py:3570, query) 2025-07-09 22:00:40 [ 656 ] DEBUG : Executing query DROP TABLE tbl ON CLUSTER 'cluster_ver' SYNC on new_node (cluster.py:3570, query) 2025-07-09 22:00:40 [ 656 ] DEBUG : Executing query RESTORE TABLE tbl ON CLUSTER 'cluster_ver' FROM Disk('backups', '1') on new_node (cluster.py:3570, query) 2025-07-09 22:00:41 [ 656 ] DEBUG : Executing query SYSTEM SYNC REPLICA ON CLUSTER 'cluster_ver' tbl on new_node (cluster.py:3570, query) 2025-07-09 22:00:41 [ 656 ] DEBUG : Executing query SELECT * FROM tbl ORDER BY x on new_node (cluster.py:3570, query) 2025-07-09 22:00:42 [ 656 ] DEBUG : Executing query SELECT * FROM tbl ORDER BY x on old_node (cluster.py:3570, query) 2025-07-09 22:00:42 [ 656 ] DEBUG : Executing query SELECT name, last_error_message FROM system.errors WHERE NOT ((name == 'NO_ELEMENTS_IN_CONFIG')) on new_node (cluster.py:3570, query) ---------------------------- Captured log teardown ----------------------------- 2025-07-09 22:00:42 [ 656 ] DEBUG : Executing query DROP TABLE IF EXISTS tbl ON CLUSTER 'cluster_ver' SYNC on new_node (cluster.py:3570, query) 2025-07-09 22:00:43 [ 656 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/.env --project-name roottestbackuprestoreonclusterdifferentversions-gw4 --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/docker-compose.yml stop --timeout 20] (cluster.py:121, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/.env --project-name roottestbackuprestoreonclusterdifferentversions-gw4 --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/new_node/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_backup_restore_on_cluster/_instances-different_versions-0-gw4/old_node/docker-compose.yml down --volumes] (cluster.py:121, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Removing (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Removing (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-new_node-1 Removed (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-old_node-1 Removed (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Removing (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Removing (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Removing (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo1-1 Removed (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo3-1 Removed (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Container roottestbackuprestoreonclusterdifferentversions-gw4-zoo2-1 Removed (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Network roottestbackuprestoreonclusterdifferentversions-gw4_default Removing (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stderr: Network roottestbackuprestoreonclusterdifferentversions-gw4_default Removed (cluster.py:147, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-09 22:00:51 [ 656 ] DEBUG : Docker networks for project roottestbackuprestoreonclusterdifferentversions-gw4 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:00:51 [ 656 ] DEBUG : Docker containers for project roottestbackuprestoreonclusterdifferentversions-gw4 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:00:51 [ 656 ] DEBUG : Docker volumes for project roottestbackuprestoreonclusterdifferentversions-gw4 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:00:51 [ 656 ] DEBUG : Command:[docker container list --all --filter name='^/roottestbackuprestoreonclusterdifferentversions-gw4-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-09 22:00:51 [ 656 ] DEBUG : No running containers for project: roottestbackuprestoreonclusterdifferentversions-gw4 (cluster.py:874, cleanup) 2025-07-09 22:00:51 [ 656 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-09 22:00:51 [ 656 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-09 22:00:51 [ 656 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-09 22:00:51 [ 656 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-09 22:00:51 [ 656 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Stdout:2 (cluster.py:145, run_and_check) 2025-07-09 22:00:51 [ 656 ] DEBUG : Command:[docker volume prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:00:52 [ 656 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:00:52 [ 656 ] DEBUG : Volumes pruned: 2 (cluster.py:910, cleanup) ____________________ test_cow_policy[cow_policy_multi_disk] ____________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 start_cluster = storage_policy = 'cow_policy_multi_disk' @pytest.mark.parametrize("storage_policy", ["cow_policy_multi_disk", "cow_policy_multi_volume"]) def test_cow_policy(start_cluster, storage_policy): try: > node.query_with_retry( f""" ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = '{storage_policy}' """, timeout=60, retry_count=3, ) test_cow_policy/test.py:24: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = sql = "\n ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7'\n (\n ...R BY (postcode1, postcode2, addr1, addr2)\n SETTINGS storage_policy = 'cow_policy_multi_disk'\n " stdin = None, timeout = 60, settings = None, user = None, password = None database = None, host = None, ignore_error = False, retry_count = 3 sleep_time = 0.5 check_callback = at 0x7fbd838449d0> parse = False def query_with_retry( self, sql, stdin=None, timeout=None, settings=None, user=None, password=None, database=None, host=None, ignore_error=False, retry_count=20, sleep_time=0.5, check_callback=lambda x: True, parse=False, ): # logging.debug(f"Executing query {sql} on {self.name}") result = None exception_msg = "" for i in range(retry_count): try: result = self.query( sql, stdin=stdin, timeout=timeout, settings=settings, user=user, password=password, database=database, host=host, ignore_error=ignore_error, parse=parse, ) if check_callback(result): return result time.sleep(sleep_time) except QueryRuntimeException as ex: exception_msg = f"{type(ex).__name__}: {str(ex)}" # Container is down, this is likely due to server crash. if "No route to host" in str(ex): raise time.sleep(sleep_time) except Exception as ex: # logging.debug("Retry {} got exception {}".format(i + 1, ex)) exception_msg = f"{type(ex).__name__}: {str(ex)}" time.sleep(sleep_time) if result is not None: return result > raise Exception(f"Can't execute query {sql}\n{exception_msg}") E Exception: Can't execute query E ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' E ( E price UInt32, E date Date, E postcode1 LowCardinality(String), E postcode2 LowCardinality(String), E type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), E is_new UInt8, E duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), E addr1 String, E addr2 String, E street LowCardinality(String), E locality LowCardinality(String), E town LowCardinality(String), E district LowCardinality(String), E county LowCardinality(String) E ) E ENGINE = MergeTree E ORDER BY (postcode1, postcode2, addr1, addr2) E SETTINGS storage_policy = 'cow_policy_multi_disk' E E QueryRuntimeException: Client failed! Return code: 198, stderr: Received exception from server (version 25.3.3): E Code: 198. DB::Exception: Received from 172.16.1.2:9000. DB::NetException. DB::NetException: Not found address of host: raw.githubusercontent.com: while loading disk metadata. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x00000000381d77f1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001bc293d1 E 2. ./src/Common/Exception.h:112: DB::NetException::NetException(int, FormatStringHelperImpl::type>, String const&) @ 0x000000001bbb2a6f E 3. ./build_docker/./src/Common/DNSResolver.cpp:113: DB::(anonymous namespace)::hostByName(String const&) @ 0x000000001bbabc1e E 4. ./build_docker/./src/Common/DNSResolver.cpp:138: DB::DNSResolver::getResolvedIPAdressessWithFiltering(String const&) @ 0x000000001bba8ba8 E 5. ./build_docker/./src/Common/DNSResolver.cpp:256: DB::DNSResolver::resolveIPAddressWithCache(String const&) @ 0x000000001bba95e0 E 6. ./build_docker/./src/Common/DNSResolver.cpp:276: DB::DNSResolver::resolveHostAllInOriginOrder(String const&) @ 0x000000001bbaa327 E 7. ./build_docker/./src/Common/HostResolvePool.cpp:54: std::vector> std::__function::__policy_invoker> (String const&)>::__call_impl[abi:ne190107]> (String const&)>>(std::__function::__policy_storage const*, String const&) @ 0x000000001c3c53a0 E 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c3c1b81 E 9. ./build_docker/./src/Common/HostResolvePool.cpp:66: DB::HostResolver::HostResolver(std::function> (String const&)>&&, String, Poco::Timespan) @ 0x000000001c3c168d E 10. ./build_docker/./src/Common/HostResolvePool.cpp:53: DB::HostResolver::HostResolver(String, Poco::Timespan) @ 0x000000001c3c1054 E 11. ./src/Common/HostResolvePool.h:62: std::shared_ptr DB::HostResolver::create(String const&)::make_shared_enabler::make_shared_enabler(String const&) @ 0x000000001c3ca810 E 12. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: std::shared_ptr DB::HostResolver::create(String const&)::make_shared_enabler> std::allocate_shared[abi:ne190107] DB::HostResolver::create(String const&)::make_shared_enabler, std::allocator DB::HostResolver::create(String const&)::make_shared_enabler>, String const&, 0>(std::allocator DB::HostResolver::create(String const&)::make_shared_enabler> const&, String const&) @ 0x000000001c3ca38d E 13. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:851: DB::HostResolversPool::getResolver(String const&) @ 0x000000001c3c518b E 14. ./build_docker/./src/Common/HTTPConnectionPool.cpp:671: DB::EndpointConnectionPool::prepareNewConnection(DB::ConnectionTimeouts const&, unsigned long*) @ 0x000000001c3ace08 E 15. ./build_docker/./src/Common/HTTPConnectionPool.cpp:590: DB::EndpointConnectionPool::getConnection(DB::ConnectionTimeouts const&, unsigned long*) @ 0x000000001c3ab190 E 16. ./build_docker/./src/IO/HTTPCommon.cpp:63: DB::makeHTTPSession(DB::HTTPConnectionGroupType, Poco::URI const&, DB::ConnectionTimeouts const&, DB::ProxyConfiguration const&, unsigned long*) @ 0x000000001c3d5134 E 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:267: DB::ReadWriteBufferFromHTTP::callImpl(Poco::Net::HTTPResponse&, String const&, std::optional const&, bool) const @ 0x000000002109bef2 E 18. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:285: DB::ReadWriteBufferFromHTTP::callWithRedirects(Poco::Net::HTTPResponse&, String const&, std::optional const&) @ 0x000000002109c57c E 19. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:408: DB::ReadWriteBufferFromHTTP::initialize() @ 0x000000002109d5fb E 20. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:472: void std::__function::__policy_invoker::__call_impl[abi:ne190107]>(std::__function::__policy_storage const*) @ 0x00000000210a2f18 E 21. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000021097f71 E 22. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:465: DB::ReadWriteBufferFromHTTP::nextImpl() @ 0x000000002109fc23 E 23. DB::ReadBuffer::next() @ 0x000000000c50420b E 24. ./src/IO/ReadBuffer.h:96: DB::WebObjectStorage::loadFiles(String const&, std::unique_lock const&) const @ 0x0000000028542882 E 25. ./build_docker/./src/Disks/ObjectStorages/Web/WebObjectStorage.cpp:225: DB::WebObjectStorage::tryGetFileInfo(String const&) const @ 0x00000000285471df E 26. ./build_docker/./src/Disks/ObjectStorages/Web/WebObjectStorage.cpp:185: DB::WebObjectStorage::tryGetFileInfo(String const&) const @ 0x0000000028546b10 E 27. ./build_docker/./src/Disks/ObjectStorages/Web/MetadataStorageFromStaticFilesWebServer.cpp:106: DB::MetadataStorageFromStaticFilesWebServer::getStorageObjectsIfExist(String const&) const @ 0x000000002853ec46 E 28. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:785: DB::DiskObjectStorage::readFileIfExists(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002844afde E 29. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:382: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000002edebcf0 E 30. ./build_docker/./src/Storages/StorageMergeTree.cpp:159: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000002f59f3b6 E 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: std::shared_ptr std::allocate_shared[abi:ne190107], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, 0>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000002f59ea16 E . (DNS_ERROR) E (query: ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' E ( E price UInt32, E date Date, E postcode1 LowCardinality(String), E postcode2 LowCardinality(String), E type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), E is_new UInt8, E duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), E addr1 String, E addr2 String, E street LowCardinality(String), E locality LowCardinality(String), E town LowCardinality(String), E district LowCardinality(String), E county LowCardinality(String) E ) E ENGINE = MergeTree E ORDER BY (postcode1, postcode2, addr1, addr2) E SETTINGS storage_policy = 'cow_policy_multi_disk' E ) helpers/cluster.py:3634: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2025-07-09 22:03:02 [ 692 ] INFO : Running tests in /ClickHouse/tests/integration/test_cow_policy/test.py (cluster.py:2672, start) 2025-07-09 22:03:02 [ 692 ] DEBUG : Cluster start called. is_up=False (cluster.py:2679, start) 2025-07-09 22:03:02 [ 692 ] DEBUG : Docker networks for project roottestcowpolicy-gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:03:02 [ 692 ] DEBUG : Docker containers for project roottestcowpolicy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:03:02 [ 692 ] DEBUG : Docker volumes for project roottestcowpolicy-gw6 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:03:02 [ 692 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : Docker networks for project roottestcowpolicy-gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:03:03 [ 692 ] DEBUG : Docker containers for project roottestcowpolicy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:03:03 [ 692 ] DEBUG : Docker volumes for project roottestcowpolicy-gw6 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:03:03 [ 692 ] DEBUG : Command:[docker container list --all --filter name='^/roottestcowpolicy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-09 22:03:03 [ 692 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : No running containers for project: roottestcowpolicy-gw6 (cluster.py:874, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:03:03 [ 692 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:03:03 [ 692 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-09 22:03:03 [ 692 ] DEBUG : Stdout:4 (cluster.py:145, run_and_check) 2025-07-09 22:03:03 [ 692 ] DEBUG : Command:[docker volume prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:03:03 [ 692 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:03:03 [ 692 ] DEBUG : Volumes pruned: 4 (cluster.py:910, cleanup) 2025-07-09 22:03:03 [ 692 ] DEBUG : Setup directory for instance: node (cluster.py:2692, start) 2025-07-09 22:03:03 [ 692 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_cow_policy/configs/overrides.yaml'] to /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/configs/config.d (cluster.py:4649, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/database (cluster.py:4666, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/logs (cluster.py:4677, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-09 22:03:03 [ 692 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/.env (cluster.py:96, _create_env_file) 2025-07-09 22:03:03 [ 692 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-09 22:03:03 [ 692 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-09 22:03:03 [ 692 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-09 22:03:03 [ 692 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-09 22:03:03 [ 692 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-07-09 22:03:03 [ 692 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/.env --project-name roottestcowpolicy-gw6 --file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: node Pulling (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: node Pulled (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/.env --project-name roottestcowpolicy-gw6 --file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/docker-compose.yml up -d --no-recreate') (cluster.py:3061, start) 2025-07-09 22:03:09 [ 692 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/.env --project-name roottestcowpolicy-gw6 --file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/docker-compose.yml up -d --no-recreate] (cluster.py:121, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: Network roottestcowpolicy-gw6_default Creating (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: Network roottestcowpolicy-gw6_default Created (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Creating (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Created (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Starting (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Started (cluster.py:147, run_and_check) 2025-07-09 22:03:09 [ 692 ] DEBUG : ClickHouse instance created (cluster.py:3069, start) 2025-07-09 22:03:09 [ 692 ] DEBUG : get_instance_ip instance_name=node (cluster.py:1999, get_instance_ip) 2025-07-09 22:03:09 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestcowpolicy-gw6-node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:09 [ 692 ] DEBUG : get_instance_ip instance_name=node (cluster.py:2009, get_instance_global_ipv6) 2025-07-09 22:03:09 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestcowpolicy-gw6-node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:09 [ 692 ] DEBUG : Waiting for ClickHouse start in node, ip: 172.16.1.2... (cluster.py:3077, start) 2025-07-09 22:03:09 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestcowpolicy-gw6-node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:09 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:10 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:11 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:11 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:11 [ 692 ] DEBUG : http://localhost:None "GET /v1.46/containers/3fc2823e75bd0d49460aa1f4107191671b2d590dd845e05b006a9b0e7fe25816/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-07-09 22:03:11 [ 692 ] DEBUG : ClickHouse node started (cluster.py:3081, start) ------------------------------ Captured log call ------------------------------- 2025-07-09 22:03:11 [ 692 ] DEBUG : Executing query ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = 'cow_policy_multi_disk' on node (cluster.py:3570, query) 2025-07-09 22:04:05 [ 692 ] DEBUG : Executing query ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = 'cow_policy_multi_disk' on node (cluster.py:3570, query) 2025-07-09 22:04:59 [ 692 ] DEBUG : Executing query ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = 'cow_policy_multi_disk' on node (cluster.py:3570, query) 2025-07-09 22:05:54 [ 692 ] DEBUG : Executing query DROP TABLE IF EXISTS uk_price_paid SYNC on node (cluster.py:3570, query) ___________________ test_cow_policy[cow_policy_multi_volume] ___________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 start_cluster = storage_policy = 'cow_policy_multi_volume' @pytest.mark.parametrize("storage_policy", ["cow_policy_multi_disk", "cow_policy_multi_volume"]) def test_cow_policy(start_cluster, storage_policy): try: > node.query_with_retry( f""" ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = '{storage_policy}' """, timeout=60, retry_count=3, ) test_cow_policy/test.py:24: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = sql = "\n ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7'\n (\n ...BY (postcode1, postcode2, addr1, addr2)\n SETTINGS storage_policy = 'cow_policy_multi_volume'\n " stdin = None, timeout = 60, settings = None, user = None, password = None database = None, host = None, ignore_error = False, retry_count = 3 sleep_time = 0.5 check_callback = at 0x7fbd838449d0> parse = False def query_with_retry( self, sql, stdin=None, timeout=None, settings=None, user=None, password=None, database=None, host=None, ignore_error=False, retry_count=20, sleep_time=0.5, check_callback=lambda x: True, parse=False, ): # logging.debug(f"Executing query {sql} on {self.name}") result = None exception_msg = "" for i in range(retry_count): try: result = self.query( sql, stdin=stdin, timeout=timeout, settings=settings, user=user, password=password, database=database, host=host, ignore_error=ignore_error, parse=parse, ) if check_callback(result): return result time.sleep(sleep_time) except QueryRuntimeException as ex: exception_msg = f"{type(ex).__name__}: {str(ex)}" # Container is down, this is likely due to server crash. if "No route to host" in str(ex): raise time.sleep(sleep_time) except Exception as ex: # logging.debug("Retry {} got exception {}".format(i + 1, ex)) exception_msg = f"{type(ex).__name__}: {str(ex)}" time.sleep(sleep_time) if result is not None: return result > raise Exception(f"Can't execute query {sql}\n{exception_msg}") E Exception: Can't execute query E ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' E ( E price UInt32, E date Date, E postcode1 LowCardinality(String), E postcode2 LowCardinality(String), E type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), E is_new UInt8, E duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), E addr1 String, E addr2 String, E street LowCardinality(String), E locality LowCardinality(String), E town LowCardinality(String), E district LowCardinality(String), E county LowCardinality(String) E ) E ENGINE = MergeTree E ORDER BY (postcode1, postcode2, addr1, addr2) E SETTINGS storage_policy = 'cow_policy_multi_volume' E E QueryRuntimeException: Client failed! Return code: 198, stderr: Received exception from server (version 25.3.3): E Code: 198. DB::Exception: Received from 172.16.1.2:9000. DB::NetException. DB::NetException: Not found address of host: raw.githubusercontent.com: while loading disk metadata. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:106: Poco::Exception::Exception(String const&, int) @ 0x00000000381d77f1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001bc293d1 E 2. ./src/Common/Exception.h:112: DB::NetException::NetException(int, FormatStringHelperImpl::type>, String const&) @ 0x000000001bbb2a6f E 3. ./build_docker/./src/Common/DNSResolver.cpp:113: DB::(anonymous namespace)::hostByName(String const&) @ 0x000000001bbabc1e E 4. ./build_docker/./src/Common/DNSResolver.cpp:138: DB::DNSResolver::getResolvedIPAdressessWithFiltering(String const&) @ 0x000000001bba8ba8 E 5. ./build_docker/./src/Common/DNSResolver.cpp:256: DB::DNSResolver::resolveIPAddressWithCache(String const&) @ 0x000000001bba95e0 E 6. ./build_docker/./src/Common/DNSResolver.cpp:276: DB::DNSResolver::resolveHostAllInOriginOrder(String const&) @ 0x000000001bbaa327 E 7. ./build_docker/./src/Common/HostResolvePool.cpp:54: std::vector> std::__function::__policy_invoker> (String const&)>::__call_impl[abi:ne190107]> (String const&)>>(std::__function::__policy_storage const*, String const&) @ 0x000000001c3c53a0 E 8. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001c3c1b81 E 9. ./build_docker/./src/Common/HostResolvePool.cpp:66: DB::HostResolver::HostResolver(std::function> (String const&)>&&, String, Poco::Timespan) @ 0x000000001c3c168d E 10. ./build_docker/./src/Common/HostResolvePool.cpp:53: DB::HostResolver::HostResolver(String, Poco::Timespan) @ 0x000000001c3c1054 E 11. ./src/Common/HostResolvePool.h:62: std::shared_ptr DB::HostResolver::create(String const&)::make_shared_enabler::make_shared_enabler(String const&) @ 0x000000001c3ca810 E 12. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: std::shared_ptr DB::HostResolver::create(String const&)::make_shared_enabler> std::allocate_shared[abi:ne190107] DB::HostResolver::create(String const&)::make_shared_enabler, std::allocator DB::HostResolver::create(String const&)::make_shared_enabler>, String const&, 0>(std::allocator DB::HostResolver::create(String const&)::make_shared_enabler> const&, String const&) @ 0x000000001c3ca38d E 13. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:851: DB::HostResolversPool::getResolver(String const&) @ 0x000000001c3c518b E 14. ./build_docker/./src/Common/HTTPConnectionPool.cpp:671: DB::EndpointConnectionPool::prepareNewConnection(DB::ConnectionTimeouts const&, unsigned long*) @ 0x000000001c3ace08 E 15. ./build_docker/./src/Common/HTTPConnectionPool.cpp:590: DB::EndpointConnectionPool::getConnection(DB::ConnectionTimeouts const&, unsigned long*) @ 0x000000001c3ab190 E 16. ./build_docker/./src/IO/HTTPCommon.cpp:63: DB::makeHTTPSession(DB::HTTPConnectionGroupType, Poco::URI const&, DB::ConnectionTimeouts const&, DB::ProxyConfiguration const&, unsigned long*) @ 0x000000001c3d5134 E 17. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:267: DB::ReadWriteBufferFromHTTP::callImpl(Poco::Net::HTTPResponse&, String const&, std::optional const&, bool) const @ 0x000000002109bef2 E 18. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:285: DB::ReadWriteBufferFromHTTP::callWithRedirects(Poco::Net::HTTPResponse&, String const&, std::optional const&) @ 0x000000002109c57c E 19. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:408: DB::ReadWriteBufferFromHTTP::initialize() @ 0x000000002109d5fb E 20. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:472: void std::__function::__policy_invoker::__call_impl[abi:ne190107]>(std::__function::__policy_storage const*) @ 0x00000000210a2f18 E 21. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x0000000021097f71 E 22. ./build_docker/./src/IO/ReadWriteBufferFromHTTP.cpp:465: DB::ReadWriteBufferFromHTTP::nextImpl() @ 0x000000002109fc23 E 23. DB::ReadBuffer::next() @ 0x000000000c50420b E 24. ./src/IO/ReadBuffer.h:96: DB::WebObjectStorage::loadFiles(String const&, std::unique_lock const&) const @ 0x0000000028542882 E 25. ./build_docker/./src/Disks/ObjectStorages/Web/WebObjectStorage.cpp:225: DB::WebObjectStorage::tryGetFileInfo(String const&) const @ 0x00000000285471df E 26. ./build_docker/./src/Disks/ObjectStorages/Web/WebObjectStorage.cpp:185: DB::WebObjectStorage::tryGetFileInfo(String const&) const @ 0x0000000028546b10 E 27. ./build_docker/./src/Disks/ObjectStorages/Web/MetadataStorageFromStaticFilesWebServer.cpp:106: DB::MetadataStorageFromStaticFilesWebServer::getStorageObjectsIfExist(String const&) const @ 0x000000002853ec46 E 28. ./build_docker/./src/Disks/ObjectStorages/DiskObjectStorage.cpp:785: DB::DiskObjectStorage::readFileIfExists(String const&, DB::ReadSettings const&, std::optional, std::optional) const @ 0x000000002844afde E 29. ./build_docker/./src/Storages/MergeTree/MergeTreeData.cpp:382: DB::MergeTreeData::initializeDirectoriesAndFormatVersion(String const&, bool, String const&, bool) @ 0x000000002edebcf0 E 30. ./build_docker/./src/Storages/StorageMergeTree.cpp:159: DB::StorageMergeTree::StorageMergeTree(DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, DB::LoadingStrictnessLevel, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>) @ 0x000000002f59f3b6 E 31. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: std::shared_ptr std::allocate_shared[abi:ne190107], DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, 0>(std::allocator const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, DB::LoadingStrictnessLevel const&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&) @ 0x000000002f59ea16 E . (DNS_ERROR) E (query: ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' E ( E price UInt32, E date Date, E postcode1 LowCardinality(String), E postcode2 LowCardinality(String), E type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), E is_new UInt8, E duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), E addr1 String, E addr2 String, E street LowCardinality(String), E locality LowCardinality(String), E town LowCardinality(String), E district LowCardinality(String), E county LowCardinality(String) E ) E ENGINE = MergeTree E ORDER BY (postcode1, postcode2, addr1, addr2) E SETTINGS storage_policy = 'cow_policy_multi_volume' E ) helpers/cluster.py:3634: Exception ------------------------------ Captured log call ------------------------------- 2025-07-09 22:05:55 [ 692 ] DEBUG : Executing query ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = 'cow_policy_multi_volume' on node (cluster.py:3570, query) 2025-07-09 22:06:52 [ 692 ] DEBUG : Executing query ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = 'cow_policy_multi_volume' on node (cluster.py:3570, query) 2025-07-09 22:07:50 [ 692 ] DEBUG : Executing query ATTACH TABLE uk_price_paid UUID 'cf712b4f-2ca8-435c-ac23-c4393efe52f7' ( price UInt32, date Date, postcode1 LowCardinality(String), postcode2 LowCardinality(String), type Enum8('other' = 0, 'terraced' = 1, 'semi-detached' = 2, 'detached' = 3, 'flat' = 4), is_new UInt8, duration Enum8('unknown' = 0, 'freehold' = 1, 'leasehold' = 2), addr1 String, addr2 String, street LowCardinality(String), locality LowCardinality(String), town LowCardinality(String), district LowCardinality(String), county LowCardinality(String) ) ENGINE = MergeTree ORDER BY (postcode1, postcode2, addr1, addr2) SETTINGS storage_policy = 'cow_policy_multi_volume' on node (cluster.py:3570, query) 2025-07-09 22:08:44 [ 692 ] DEBUG : Executing query DROP TABLE IF EXISTS uk_price_paid SYNC on node (cluster.py:3570, query) ---------------------------- Captured log teardown ----------------------------- 2025-07-09 22:08:45 [ 692 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/.env --project-name roottestcowpolicy-gw6 --file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/docker-compose.yml stop --timeout 20] (cluster.py:121, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:121, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/.env --project-name roottestcowpolicy-gw6 --file /ClickHouse/tests/integration/test_cow_policy/_instances-0-gw6/node/docker-compose.yml down --volumes] (cluster.py:121, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Stopping (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Stopped (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Removing (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Container roottestcowpolicy-gw6-node-1 Removed (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Network roottestcowpolicy-gw6_default Removing (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stderr: Network roottestcowpolicy-gw6_default Removed (cluster.py:147, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-09 22:08:51 [ 692 ] DEBUG : Docker networks for project roottestcowpolicy-gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-09 22:08:51 [ 692 ] DEBUG : Docker containers for project roottestcowpolicy-gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-09 22:08:51 [ 692 ] DEBUG : Docker volumes for project roottestcowpolicy-gw6 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-09 22:08:51 [ 692 ] DEBUG : Command:[docker container list --all --filter name='^/roottestcowpolicy-gw6-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-09 22:08:51 [ 692 ] DEBUG : No running containers for project: roottestcowpolicy-gw6 (cluster.py:874, cleanup) 2025-07-09 22:08:51 [ 692 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-09 22:08:51 [ 692 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-09 22:08:51 [ 692 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-09 22:08:51 [ 692 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-09 22:08:51 [ 692 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-09 22:08:51 [ 692 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) ----------------- generated report log file: parallel0_0.jsonl ----------------- ============================== slowest durations =============================== 671.28s setup test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column 631.51s setup test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 176.70s setup test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0] 169.59s call test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume] 163.93s call test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk] 133.76s call test_backup_restore_new/test_cancel_backup.py::test_cancel_backup 95.01s call test_distributed_load_balancing/test.py::test_load_balancing_first_or_random 93.99s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 93.03s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 90.99s call test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance 88.63s call test_distributed_load_balancing/test.py::test_load_balancing_default 80.87s call test_distributed_load_balancing/test.py::test_load_balancing_in_order 80.28s call test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname 50.74s call test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop 48.87s setup test_dictionaries_redis/test_long.py::test_redis_dict_long 40.17s call test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat] 38.53s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat] 36.96s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct] 36.16s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache] 34.80s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache] 34.50s call test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed] 34.36s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed] 34.11s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct] 33.95s call test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed] 31.84s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed] 30.89s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache] 29.29s teardown test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576] 27.37s call test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 26.19s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] 22.71s setup test_encrypted_disk_replication/test.py::test_replication 22.58s call test_broken_projections/test.py::test_mutation_with_broken_projection 22.20s setup test_backup_restore_on_cluster/test_different_versions.py::test_different_versions 22.15s teardown test_encrypted_disk_replication/test.py::test_zero_copy_replication 21.89s teardown test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable 21.78s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] 21.77s setup test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable 21.58s teardown test_endpoint_macro_substitution/test.py::test_select_by_type 20.78s setup test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] 20.71s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 20.66s teardown test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 20.29s call test_broken_projections/test.py::test_broken_ignored 20.00s setup test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table 19.55s call test_broken_projections/test.py::test_broken_on_start 19.39s setup test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl 19.23s setup test_ddl_alter_query/test.py::test_alter 19.21s call test_dictionaries_redis/test_long.py::test_redis_dict_long 19.15s setup test_broken_projections/test.py::test_broken_ignored 18.99s call test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load 18.95s setup test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster 18.62s setup test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors 18.51s setup test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach 17.51s call test_disk_access_storage/test.py::test_drop 17.45s setup test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop 16.90s call test_broken_projections/test.py::test_broken_projections_in_backups_2 16.59s call test_config_xml_main/test.py::test_xml_main_conf 16.01s teardown test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop 15.97s call test_disk_access_storage/test.py::test_alter 15.89s setup test_compression_nested_columns/test.py::test_nested_compression_codec 15.18s setup test_dictionaries_access/test.py::test_create 15.18s setup test_disk_access_storage/test.py::test_alter 15.06s call test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0] 14.96s setup test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed] 14.86s setup test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility 14.86s call test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed] 14.56s call test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed] 13.89s call test_broken_projections/test.py::test_disappeared_projection_on_start 13.79s call test_disk_access_storage/test.py::test_create 13.61s call test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster 13.51s setup test_concurrent_queries_for_user_restriction/test.py::test_exception_message 13.07s setup test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary 12.88s setup test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings 12.81s setup test_attach_table_normalizer/test.py::test_attach_substr 12.68s setup test_config_reloader_interval/test.py::test_reload_config 12.58s call test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup 12.54s setup test_distributed_config/test.py::test_distibuted_settings 12.52s setup test_custom_settings/test.py::test_custom_settings 12.50s setup test_enabling_access_management/test.py::test_enabling_access_management 12.25s call test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 11.92s call test_allow_feature_tier/test.py::test_allow_feature_tier_in_user 11.66s setup test_executable_dictionary/test.py::test_executable_implicit_input_argument_python 11.00s call test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576] 10.69s setup test_endpoint_macro_substitution/test.py::test_select_by_type 10.23s setup test_cluster_discovery/test_password.py::test_connect_with_password 10.21s call test_broken_projections/test.py::test_broken_ignored_replicated 10.15s call test_broken_projections/test.py::test_broken_projections_in_backups_3 9.84s call test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings 9.41s teardown test_backup_restore_on_cluster/test_different_versions.py::test_different_versions 9.17s teardown test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 8.57s call test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 8.53s teardown test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 8.43s teardown test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] 8.35s setup test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk] 8.30s call test_distributed_load_balancing/test.py::test_load_balancing_round_robin 7.99s call test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] 7.96s teardown test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl 7.80s call test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative] 7.70s call test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority] 7.52s call test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors 7.24s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed] 6.74s teardown test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume] 6.72s setup test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 6.69s teardown test_distributed_load_balancing/test.py::test_load_balancing_round_robin 6.56s call test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 6.39s call test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 6.07s teardown test_distributed_config/test.py::test_distibuted_settings 6.03s teardown test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility 5.86s teardown test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster 5.51s teardown test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 5.37s call test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table 5.36s teardown test_concurrent_queries_for_user_restriction/test.py::test_exception_message 5.22s teardown test_compression_nested_columns/test.py::test_nested_compression_codec 5.12s teardown test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed] 5.08s call test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] 5.04s setup test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load 4.83s call test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility 4.68s call test_broken_projections/test.py::test_materialize_broken_projection 4.63s teardown test_enabling_access_management/test.py::test_enabling_access_management 4.51s teardown test_dictionaries_redis/test_long.py::test_redis_dict_long 4.38s call test_broken_projections/test.py::test_check_part_thread 4.13s call test_distributed_ddl_on_cross_replication/test.py::test_atomic_database 4.11s teardown test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column 4.08s setup test_backup_restore_new/test_cancel_backup.py::test_cancel_backup 3.94s call test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] 3.90s teardown test_custom_settings/test.py::test_illformed_setting 3.72s teardown test_config_reloader_interval/test.py::test_reload_config 3.34s call test_backup_restore_on_cluster/test_different_versions.py::test_different_versions 3.29s call test_dictionaries_access/test.py::test_create 3.27s teardown test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 3.21s teardown test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load 3.14s teardown test_broken_projections/test.py::test_mutation_with_broken_projection 3.09s call test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl 3.09s call test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach 2.84s call test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] 2.74s call test_attach_table_normalizer/test.py::test_attach_substr_restart 2.73s call test_compression_nested_columns/test.py::test_nested_compression_codec 2.60s call test_ddl_alter_query/test.py::test_alter 2.56s teardown test_dictionaries_access/test.py::test_drop 2.56s teardown test_cluster_discovery/test_password.py::test_connect_with_password 2.54s call test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings 2.22s teardown test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach 2.11s call test_encrypted_disk_replication/test.py::test_replication 1.95s call test_dictionaries_access/test.py::test_dictget 1.78s call test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column 1.77s call test_cluster_discovery/test_password.py::test_connect_with_password 1.76s teardown test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup 1.70s call test_encrypted_disk_replication/test.py::test_zero_copy_replication 1.68s call test_enabling_access_management/test.py::test_enabling_access_management 1.63s call test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility 1.58s call test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile 1.51s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] 1.49s call test_concurrent_queries_for_user_restriction/test.py::test_exception_message 1.48s teardown test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile 1.47s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] 1.44s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] 1.43s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] 1.39s setup test_disk_access_storage/test.py::test_drop 1.38s teardown test_attach_table_normalizer/test.py::test_attach_substr_restart 1.37s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] 1.36s teardown test_executable_dictionary/test.py::test_executable_implicit_input_bash 1.36s teardown test_disk_access_storage/test.py::test_drop 1.31s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] 1.25s call test_executable_dictionary/test.py::test_executable_implicit_input_argument_python 1.24s call test_distributed_config/test.py::test_distibuted_settings 1.24s call test_dictionaries_access/test.py::test_drop 1.21s call test_custom_settings/test.py::test_custom_settings 1.20s call test_config_reloader_interval/test.py::test_reload_config 1.12s call test_attach_table_normalizer/test.py::test_attach_substr 1.10s call test_executable_dictionary/test.py::test_executable_implicit_input_bash 1.07s call test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl 1.04s setup test_disk_access_storage/test.py::test_create 0.98s teardown test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table 0.95s setup test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance 0.95s setup test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative] 0.90s setup test_distributed_load_balancing/test.py::test_load_balancing_in_order 0.85s setup test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority] 0.81s setup test_distributed_load_balancing/test.py::test_load_balancing_first_or_random 0.80s setup test_distributed_load_balancing/test.py::test_load_balancing_round_robin 0.78s call test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable 0.75s setup test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname 0.70s call test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 0.65s setup test_distributed_load_balancing/test.py::test_load_balancing_default 0.65s call test_endpoint_macro_substitution/test.py::test_select_by_type 0.43s call test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility 0.43s call test_custom_settings/test.py::test_illformed_setting 0.42s teardown test_encrypted_disk_replication/test.py::test_replication 0.38s teardown test_dictionaries_access/test.py::test_dictget 0.34s teardown test_dictionaries_access/test.py::test_create 0.32s call test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary 0.27s teardown test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] 0.27s teardown test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] 0.27s teardown test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] 0.22s teardown test_backup_restore_new/test_cancel_backup.py::test_cancel_backup 0.22s call test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 0.01s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool 0.01s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 0.01s teardown test_distributed_load_balancing/test.py::test_load_balancing_default 0.00s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated 0.00s setup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup 0.00s teardown test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat] 0.00s setup test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 0.00s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed] 0.00s setup test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 0.00s teardown test_broken_projections/test.py::test_broken_ignored 0.00s teardown test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas 0.00s setup test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache] 0.00s teardown test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility 0.00s setup test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed] 0.00s teardown test_broken_projections/test.py::test_broken_projections_in_backups_2 0.00s setup test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576] 0.00s teardown test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 0.00s setup test_broken_projections/test.py::test_broken_projections_in_backups_3 0.00s setup test_attach_table_normalizer/test.py::test_attach_substr_restart 0.00s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat] 0.00s setup test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility 0.00s teardown test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance 0.00s teardown test_distributed_load_balancing/test.py::test_load_balancing_first_or_random 0.00s setup test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct] 0.00s setup test_broken_projections/test.py::test_broken_ignored_replicated 0.00s setup test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache] 0.00s setup test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 0.00s teardown test_distributed_load_balancing/test.py::test_load_balancing_in_order 0.00s setup test_config_xml_main/test.py::test_xml_main_conf 0.00s teardown test_ddl_alter_query/test.py::test_alter 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed] 0.00s setup test_encrypted_disk_replication/test.py::test_zero_copy_replication 0.00s teardown test_broken_projections/test.py::test_check_part_thread 0.00s setup test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 0.00s teardown test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 0.00s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache] 0.00s setup test_broken_projections/test.py::test_mutation_with_broken_projection 0.00s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed] 0.00s setup test_broken_projections/test.py::test_broken_on_start 0.00s teardown test_broken_projections/test.py::test_broken_on_start 0.00s setup test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl 0.00s setup test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct] 0.00s setup test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] 0.00s teardown test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl 0.00s setup test_allow_feature_tier/test.py::test_allow_feature_tier_in_user 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed] 0.00s teardown test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] 0.00s teardown test_custom_settings/test.py::test_custom_settings 0.00s teardown test_broken_projections/test.py::test_broken_ignored_replicated 0.00s setup test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] 0.00s setup test_dictionaries_access/test.py::test_drop 0.00s setup test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary 0.00s setup test_custom_settings/test.py::test_illformed_setting 0.00s setup test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile 0.00s teardown test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname 0.00s setup test_dictionaries_access/test.py::test_dictget 0.00s setup test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] 0.00s teardown test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative] 0.00s teardown test_disk_access_storage/test.py::test_alter 0.00s teardown test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority] 0.00s teardown test_attach_table_normalizer/test.py::test_attach_substr 0.00s setup test_broken_projections/test.py::test_broken_projections_in_backups_2 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] 0.00s teardown test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 0.00s teardown test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors 0.00s teardown test_config_xml_main/test.py::test_xml_main_conf 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] 0.00s teardown test_executable_dictionary/test.py::test_executable_implicit_input_argument_python 0.00s teardown test_disk_access_storage/test.py::test_create 0.00s teardown test_allow_feature_tier/test.py::test_allow_feature_tier_in_user 0.00s teardown test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct] 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] 0.00s setup test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 0.00s setup test_distributed_ddl_on_cross_replication/test.py::test_atomic_database 0.00s setup test_broken_projections/test.py::test_check_part_thread 0.00s setup test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] 0.00s setup test_executable_dictionary/test.py::test_executable_implicit_input_bash 0.00s teardown test_broken_projections/test.py::test_broken_projections_in_backups_3 0.00s teardown test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings 0.00s teardown test_distributed_ddl_on_cross_replication/test.py::test_atomic_database 0.00s teardown test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] 0.00s setup test_broken_projections/test.py::test_disappeared_projection_on_start 0.00s setup test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume] 0.00s teardown test_broken_projections/test.py::test_materialize_broken_projection 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] 0.00s teardown test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility 0.00s setup test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings 0.00s setup test_broken_projections/test.py::test_materialize_broken_projection 0.00s teardown test_broken_projections/test.py::test_disappeared_projection_on_start =========================== short test summary info ============================ FAILED test_backup_restore_on_cluster/test_different_versions.py::test_different_versions FAILED test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk] - Exce... FAILED test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume] - Ex... ERROR test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible ERROR test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings PASSED test_dictionaries_access/test.py::test_create PASSED test_dictionaries_access/test.py::test_dictget PASSED test_dictionaries_access/test.py::test_drop PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0] PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings PASSED test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] PASSED test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] PASSED test_disk_access_storage/test.py::test_alter PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] PASSED test_allow_feature_tier/test.py::test_allow_feature_tier_in_user PASSED test_broken_projections/test.py::test_broken_ignored PASSED test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile PASSED test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3] PASSED test_disk_access_storage/test.py::test_create PASSED test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed] PASSED test_broken_projections/test.py::test_broken_ignored_replicated PASSED test_distributed_ddl_on_cross_replication/test.py::test_atomic_database PASSED test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl PASSED test_attach_table_normalizer/test.py::test_attach_substr PASSED test_attach_table_normalizer/test.py::test_attach_substr_restart PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed] PASSED test_disk_access_storage/test.py::test_drop PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache] PASSED test_broken_projections/test.py::test_broken_on_start PASSED test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility PASSED test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table PASSED test_broken_projections/test.py::test_broken_projections_in_backups_2 PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path PASSED test_broken_projections/test.py::test_broken_projections_in_backups_3 PASSED test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary PASSED test_broken_projections/test.py::test_check_part_thread PASSED test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct] PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat] PASSED test_custom_settings/test.py::test_custom_settings PASSED test_custom_settings/test.py::test_illformed_setting PASSED test_broken_projections/test.py::test_disappeared_projection_on_start PASSED test_distributed_load_balancing/test.py::test_load_balancing_default PASSED test_broken_projections/test.py::test_materialize_broken_projection PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed] PASSED test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed] PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated PASSED test_broken_projections/test.py::test_mutation_with_broken_projection PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed] PASSED test_cluster_discovery/test_password.py::test_connect_with_password PASSED test_compression_nested_columns/test.py::test_nested_compression_codec PASSED test_encrypted_disk_replication/test.py::test_replication PASSED test_encrypted_disk_replication/test.py::test_zero_copy_replication PASSED test_concurrent_queries_for_user_restriction/test.py::test_exception_message PASSED test_config_xml_main/test.py::test_xml_main_conf PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache] PASSED test_backup_restore_new/test_cancel_backup.py::test_cancel_backup PASSED test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load PASSED test_distributed_load_balancing/test.py::test_load_balancing_first_or_random PASSED test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach PASSED test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct] PASSED test_executable_dictionary/test.py::test_executable_implicit_input_argument_python PASSED test_executable_dictionary/test.py::test_executable_implicit_input_bash PASSED test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas PASSED test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable PASSED test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0] PASSED test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster PASSED test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool PASSED test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576] PASSED test_dictionaries_redis/test_long.py::test_redis_dict_long PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat] PASSED test_endpoint_macro_substitution/test.py::test_select_by_type PASSED test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf PASSED test_distributed_config/test.py::test_distibuted_settings PASSED test_enabling_access_management/test.py::test_enabling_access_management PASSED test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed] PASSED test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance PASSED test_distributed_load_balancing/test.py::test_load_balancing_in_order PASSED test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname PASSED test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority] PASSED test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative] PASSED test_distributed_load_balancing/test.py::test_load_balancing_round_robin PASSED test_ddl_alter_query/test.py::test_alter PASSED test_ddl_alter_query/test.py::test_ddl_queue_hostname_change PASSED test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column PASSED test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop PASSED test_config_reloader_interval/test.py::test_reload_config SKIPPED [1] test_asynchronous_metric_jemalloc_profile_active/test.py:30: Disabled for sanitizers ======== 3 failed, 94 passed, 1 skipped, 2 errors in 897.72s (0:14:57) ========= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_2f7iop --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_allow_feature_tier/test.py::test_allow_feature_tier_in_general_settings test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings test_allow_feature_tier/test.py::test_allow_feature_tier_in_mergetree_settings_with_old_compatibility test_allow_feature_tier/test.py::test_allow_feature_tier_in_user test_allow_feature_tier/test.py::test_it_is_possible_to_enable_experimental_settings_in_default_profile test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_attach_table_normalizer/test.py::test_attach_substr test_attach_table_normalizer/test.py::test_attach_substr_restart 'test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[0]' 'test_azure_blob_storage_plain_rewritable/test.py::test_insert_select[1048576]' test_backup_restore_new/test_cancel_backup.py::test_cancel_backup test_backup_restore_new/test_cancel_backup.py::test_shutdown_cancel_backup test_backup_restore_on_cluster/test_different_versions.py::test_different_versions test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy]' test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_select_aggregate_alias_column.py::test_select_aggregate_alias_column test_broken_projections/test.py::test_broken_ignored test_broken_projections/test.py::test_broken_ignored_replicated test_broken_projections/test.py::test_broken_on_start test_broken_projections/test.py::test_broken_projections_in_backups_2 test_broken_projections/test.py::test_broken_projections_in_backups_3 test_broken_projections/test.py::test_check_part_thread test_broken_projections/test.py::test_disappeared_projection_on_start test_broken_projections/test.py::test_materialize_broken_projection test_broken_projections/test.py::test_mutation_with_broken_projection test_cluster_discovery/test_auxiliary_keeper.py::test_cluster_discovery_with_auxiliary_keeper_startup_and_stop test_cluster_discovery/test_password.py::test_connect_with_password test_compatibility_merge_tree_settings/test.py::test_check_projections_compatibility test_compatibility_merge_tree_settings/test.py::test_config_overrides_compatibility test_compression_nested_columns/test.py::test_nested_compression_codec test_concurrent_queries_for_user_restriction/test.py::test_exception_message test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_in_empty_pool_replicated test_concurrent_ttl_merges/test.py::test_limited_ttl_merges_two_replicas test_concurrent_ttl_merges/test.py::test_no_ttl_merges_in_busy_pool test_config_reloader_interval/test.py::test_reload_config test_config_xml_main/test.py::test_xml_main_conf test_config_yaml_merge_keys/test.py::test_yaml_merge_keys_conf 'test_cow_policy/test.py::test_cow_policy[cow_policy_multi_disk]' 'test_cow_policy/test.py::test_cow_policy[cow_policy_multi_volume]' test_custom_settings/test.py::test_custom_settings test_custom_settings/test.py::test_illformed_setting test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_deduplicated_attached_part_rename/test.py::test_deduplicated_attached_part_renamed_after_attach test_dictionaries_access/test.py::test_create test_dictionaries_access/test.py::test_dictget test_dictionaries_access/test.py::test_drop 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_file.py::test_simple[hashed]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_mysql.py::test_simple[hashed]' test_dictionaries_redis/test_long.py::test_redis_dict_long 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary0-instances_to_check0]' 'test_dictionaries_replace/test.py::test_create_or_replace[atomicdb-instance_to_create_dictionary1-instances_to_check1]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary2-instances_to_check2]' 'test_dictionaries_replace/test.py::test_create_or_replace[repldb-instance_to_create_dictionary3-instances_to_check3]' test_dictionaries_wait_for_load/test.py::test_wait_for_dictionaries_load test_dictionaries_with_invalid_structure/test.py::test_dictGet_func_for_invalid_dictionary test_dictionaries_with_invalid_structure/test.py::test_select_from_system_dictionaries_with_invalid_dictionary test_dictionary_ddl_on_cluster/test.py::test_dictionary_ddl_on_cluster test_disk_access_storage/test.py::test_alter test_disk_access_storage/test.py::test_create test_disk_access_storage/test.py::test_drop test_disks_app_other_disk_types/test.py::test_disks_app_plain_rewritable test_distributed_config/test.py::test_distibuted_settings test_distributed_ddl_on_cross_replication/test.py::test_alter_ddl test_distributed_ddl_on_cross_replication/test.py::test_atomic_database test_distributed_ddl_on_cross_replication/test.py::test_non_query_with_table_ddl test_distributed_load_balancing/test.py::test_distributed_replica_max_ignored_errors test_distributed_load_balancing/test.py::test_load_balancing_default test_distributed_load_balancing/test.py::test_load_balancing_first_or_random test_distributed_load_balancing/test.py::test_load_balancing_hostname_levenshtein_distance test_distributed_load_balancing/test.py::test_load_balancing_in_order test_distributed_load_balancing/test.py::test_load_balancing_nearest_hostname 'test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority]' 'test_distributed_load_balancing/test.py::test_load_balancing_priority_round_robin[dist_priority_negative]' test_distributed_load_balancing/test.py::test_load_balancing_round_robin test_enabling_access_management/test.py::test_enabling_access_management test_encrypted_disk_replication/test.py::test_replication test_encrypted_disk_replication/test.py::test_zero_copy_replication test_endpoint_macro_substitution/test.py::test_select_by_type test_executable_dictionary/test.py::test_executable_implicit_input_argument_python test_executable_dictionary/test.py::test_executable_implicit_input_bash -vvv " altinityinfra/integration-tests-runner:ad96270260ff ' returned non-zero exit status 1.